Software Engineering Senior Advisor- Hybrid

Cigna-Evernorth Services Inc. seeks a Software Engineering Senior Advisor for the Raleigh, NC location to design and build scalable data pipelines and ETL/ELT processes that can handle large amounts of both structured and unstructured data while ensuring security and reliability.

Responsibilities:

- Create and maintain data warehouse and data lake solutions using on-prem and cloud platforms like AWS.

- Design database structures and data models that perform well for analytical queries and reporting needs.

- Write clear technical documentation and specifications that explain how our data systems work.

- Research and recommend new data technologies and tools that can make our data infrastructure better and more efficient.

- Build, test, and deploy data pipelines using industry-standard tools such as Data Bricks, Airflow, Kafka, and similar technologies.

- Write and optimize SQL queries, stored procedures, and database components to extract and transform data efficiently.

- Create solutions that process data both in real-time and in batches.

- Set up automated checks to validate data quality and catch errors early in the pipeline.

- Connect and pull data from various sources including APIs, different databases, files, and streaming data platforms.

- Make data pipelines run faster and more cost-effectively through optimization.

- Build frameworks and monitoring systems to ensure our data is accurate and trustworthy.

- Create and enforce data governance policies that set standards for how we handle and manage data.

- Implement security measures like encryption and access controls to protect sensitive data and ensure compliance with regulations such as GDPR, CCPA, or HIPAA.

- Perform data audits to find and fix any data integrity problems.

- Maintain documentation including data dictionaries, lineage tracking (showing where data comes from and where it goes), and metadata systems.

- Guide and mentor junior data engineers and analysts, helping them grow their skills.

- Review code written by team members to ensure quality and adherence to best practices.

- Lead discussions about technical design decisions and review proposed architectures.

- Work closely with software engineers and business analysts to understand what they need and deliver effective solutions.

- Monitor data systems to ensure they're running smoothly and fix issues when they arise.

- Find and eliminate performance bottlenecks that slow down data processing or storage.

- Set up monitoring and alert systems so we know immediately when something goes wrong with our data pipelines.

- Investigate the root causes of data incidents and put safeguards in place to prevent them from happening again.

- Manage cloud resources efficiently to keep costs under control while maintaining performance.

- Work with business stakeholders to understand their data needs and translate those needs into technical solutions.

- Provide technical advice and consultation to product managers and business leaders.

- Explain complex technical concepts in simple terms that non-technical tea members can understand.

- Create clear documentation for technical processes, procedures, and system configurations so others can understand and maintain them.

- Hybrid work schedule.

Qualifications:

- Bachelor's degree in Computer Science, Electrical Engineering or related field and 5 years of experience in any software development role.

- Will accept a Master's degree and 3 years of experience.

- Must have experience with:
Hands-on experience in designing, building, and optimizing end-to-end applications using Python, Java, PL/SQL, APIs, and frameworks;

- Software Development Life Cycle;
Clean code practices;
Debugging;
Unit testing;

- Delivering scalable software;
Modern data ecosystems including Data Lakes, Lakehouse, ELT/ETL pipelines, streaming, and batch processing;

- Building scalable data ingestion, transformation, orchestration, and optimization using cloud-native services including AWS and Databricks;

- Tableau including building complex reports and hierarchical computations reports;
Performance optimization;
Report optimization;
Writing a data pipeline using PySpark;

- Informatica Power Center…