Software Developer, Data Engineering, Data Analyst

Key Responsibilities:

• Design and Implement solution to migrate or build new applications on Public/Private Cloud using expertise building petabyte scale data lake using cloud technologies and experience in performing Hadoop and cloud migration in previous projects.
• Design and Implementsolutionsto upgrade legacy applications by adding new capabilities for better ROI, scaling (Horizontal/Vertical) and performance improvements. Maintain, Enhance and Debug existing enterprise application to add new features and resolve existing errors in the Application using programming languages Python, R, JavaScript developed on Visual Studio, Eclipse, PyCharm and GITHUB as a code repository.
• Design and Implement Solution to extract, Load and Transform data coming from various sources and then Store, retrieve, and manipulate the data for further analysis, decision making and reporting using Cloud technologies - S3, EC2, EMR, RDS, API Gateway, Redshift, Glue and Lake Formation or similar tools in case of other Cloud providers.
• Running Machine Learning experiments using a Python programming language with machine learning libraries. Deploying machine learning solutions into production. Optimizing solutions for performance and scalability using AWS Sage Maker.
• Develop best practices for database design for structured and unstructured data, development activities, standard naming conventions and coding practices to ensure consistency of data models.
• Design Big Data database, data models, ETL processes, data warehouse applications and business intelligence reports using best practices and tools, including SQL, HQL, AWS Database Services, Big Data, No
  
  SQL and OLAP using EMR, Spark, Presto, Athena, Databricks, Redshift, Cloudera, Hive, Impala and Salesforce.
• Deliver ETL processes, data warehouse designs, and data system enhancements in accordance with existing standards and guidelines to maintain Data Management and Data Governance using Alation, Glue, Lake Formation and Unifi.
• Work with the Customer to gather requirements, analyze and perform feasibility study and then design and implement solutions within estimated time and budget ensuring quality requirements are met. Customer requirements to be documented in Confluence and then the requirements will be broken down into features and User stories in JIRA.
• Analyze user needs and software requirements to determine feasibility of design within time and cost constraints. The requirements documentation and the design will be done using Confluence or Microsoft Office or Google Suite.
• Confer with systems analysts, engineers, programmers, and others to design systems and to obtain information on project limitations and capabilities, performance requirements and interface using collaboration tools like Slack, Google Hangouts, Google Docs, Google Sheets and Google PowerPoint and Confluence.
• Assist in building a roadmap that guides an organization based on TOGAF standards by defining all aspects of technology and ensure all processes within a company are in sync. This will help ensure there is an alignment between an organization's goals and the technology. Oversee the life cycles of technology in a company, especially when there are new updates, versions, or changes.
• Design, develop, modify, and estimate software systems, using scientific analysis and mathematical models (WSJF, Critical Path, Scaled Agile etc.), to predict and measure outcome. The information will be documented using Atlassian product Confluence.
• Develop and direct software system testing, automation, validation procedures and documentation. The validation process will be fully automated using the JUNITframework in Java for unit testing, Scala & Spark in case of automated validation of Big Data for functional testing and JIRA for logging the defects.
• Supervise the work of programmers, technologists and technicians and other engineering and scientific personnel using Confluence, Agile Craft, and JIRA.
• Establish system performance benchmarks based on standards on customer feedback and implementsolutionsfor the same.
• Coordinate software system installation and monitor its functioning to ensure specifications are met.
• Coordinate with clients, data users and key stakeholders and develop and achieve various long-term objectives for data architecture.
• Use Fin Tech to streamline complex finance and admin processes with automated workflows to ensure full legal compliance, audit capabilities, and maximum efficiency of finance and admin processes by seamlessly…