Data Engineer

Join to apply for the Staff Data Engineer role at Market America, Inc.

Market America is a product brokerage and Internet marketing company specializing in One‑to‑One Marketing. As a senior member of the Data Engineering team, you will help millions of customers on our  and Market America Worldwide multi‑country, multi‑language eCommerce websites find what they need within categories, merchant offers, products, and taxonomy.

• Minimum of 10-12 years of hands‑on development experience implementing batch and event‑driven applications using Java, Kafka, Spark, Scala, PySpark, and Python.
• Experience with Apache Kafka and connectors, Java Spring Boot for event‑driven services, and Python for ML pipelines.
• Develop data pipelines ingesting large amounts of diverse data from various sources.
• Help evolve data architecture and work on next‑generation real‑time pipeline algorithms and architecture while supporting and maintaining current pipelines and legacy systems.
• Write code and develop worker nodes for business logic, ETL, and orchestration processes.
• Develop algorithms for better attribution rules and category classifiers.
• Work with stakeholders across the organization to identify opportunities for leveraging company data to drive search, discovery, and recommendations.
• Collaborate with architects, engineers, data analysts, data scientists, contractors, and project managers to assess project requirements, design, develop, and support data ingestions and API services.
• Collaborate with Data Scientists to build feature–engineering pipelines and integrate machine learning models during content enrichment.
• Influence priorities working with engineers, project management, and leadership.
• Mentor junior team members; define architecture, conduct code reviews, and deliver work in sprint cycles.
• Participate in design discussions with Architects and other team members for new systems and re‑engineering of existing components.
• Take a holistic approach to building solutions by thinking big picture and overall solution.
• Work on moving away from legacy systems into next‑generation architecture.
• Own requirements, solution design, development, production launch, and post‑launch support; participate in code reviews and on‑call rotations.
• Apply industry best solutions, correct design patterns, and learn best practices and data‑engineering tools and technologies.

• BS or MS in Computer Science (or related field) with 10+ years of hands‑on software development experience in large‑scale data processing pipelines.
• Expertise in Apache Spark, Scala, and PySpark with 2-4 years of experience building production‑grade batch pipelines handling large volumes of data.
• 4+ years of experience in Java and API / microservices.
• 2+ years of experience in Python.
• 2+ years of experience writing complex SQL and stored procedures for raw data processing, ETL, data validation, using SQL Server, Redis, and other No
  
  SQL databases.
• Knowledge of Hadoop, HDFS, and Big Data technologies.
• Experience building event‑driven pipelines with Kafka, Java / Spark, and Apache Flink.
• Proficiency with Amazon AWS stack such as EMR, EC2, S3.
• Experience working with APIs to collect and ingest data and building APIs for business logic.
• Experience maintaining, debugging, and setting up production systems and infrastructure.
• Experience building fault‑tolerant and resilient systems.
• Experience building worker nodes, knowledge of REST principles, and data‑engineering design patterns.
• Strong software development, architecture diagramming, problem‑solving, and debugging skills.
• Phenomenal communication and influencing skills.

• Exposure to Machine Learning (ML), LLM models, and using AI during coding.
• Knowledge of Elastic APM, ELK stack, and search technologies such as Elasticsearch or Solr.
• Experience with workflow orchestration tools such as Airflow or Apache NiFi.

Market America offers competitive salary and generous benefits, including health, dental, vision, life, short and long‑term disability insurance, a 401(k) retirement plan with company match, and an on‑site health clinic.

Qualified candidates should apply online. This position can be remote based from either our Greensboro, NC or Monterey, CA offices. We are not able to sponsor for this position.

Market America is proud to be an equal opportunity employer.