More jobs:
Job Description & How to Apply Below
We are seeking a Sr. Data Engineer own and operate a large-scale data processing and reconciliation platform for an eCommerce enterprise. The role involves execution, support and enhancement of real-time data ingestion and batch processing ETL dataflows (SQL, Python, PySpark, Hive), and SLA based execution of SQL based financial report generation.
You will be responsible for triaging reconciliation issues, performing deep root cause analysis (RCA) using data from MySQL, HBase, and HDFS, and implementing fixes with a focus on process automation, data lineage (Data Hub), and platform reliability.
Key Responsibilities:
Execute large scale data processing and report generation for in order to drive successful financial reconciliation on monthly basis. Work closely with the Finance Controllers.
Perform RCA, issue triaging and resolve anomalies
Build and monitor data quality, lineage, and SLA adherence across systems
Enable observability through monitoring dashboards and diagnostics
Required Skills:
Strong hands-on experience with: SQL, Python( or PySpark) Based ETL for a Data Lake environment (or a large DWH platform)
Proficiency in SQL and Python (PySpark) performance tuning, and building complex business logic
Knowledge of data lineage, data governance frameworks, and BI tools (Tableau, Click View)
Fast learner and willing to learn new data analytics tools, basic java programming and microservices architecture
Position Requirements
10+ Years
work experience
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
Search for further Jobs Here:
×