Top Skills - Must Haves
Top Skills' DetailsPython - developing scalable and efficient data pipelines and automate data workflows enabling the processing of large volumes of data
SQL - designing, optimizing and maintaining databases and data pipelines using queries
Scala - develop robust data pipelines and application of large-scale data sets
AWS - development and optimization of all aspects of cloud infrastructure Secondary Skills - Nice to Haves
Job DescriptionResponsibilities:
- Work on migrating applications from an on-premises location to the cloud service providers.
- Develop products and services on the latest technologies through contributions in development, enhancements, testing and implementation.
- Develop, modify, extend code for building cloud infrastructure, and automate using CI/CD pipeline.
- Partners with business and peers in the pursuit of solutions that achieve business goals through an agile software development methodology.
- Perform problem analysis, data analysis, reporting, and communication.
- Work with peers across the system to define and implement best practices and standards.
- Assess applications and help determine the appropriate application infrastructure patterns.
- Use best practices and knowledge of internal or external drivers to improve products or services.
Qualifications:
Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps is required.
Expert-level expertise in SQL, Python, Scala or similar; other object-oriented programming experience a plus
Expert-level experience in data architecture, data types/formats, optimizing code and ETL jobs, data architecture, data modeling, data contracts – a key requirement for successful collaboration with data architects and visualization developers.
Expert-level professional hands-on experience in extensible data pipeline development using Databricks, Alteryx, AWS Glue and Lambda functions.
Expert-level professional hands-on experience with RDBMS, ETL scripting tools and IDEs, data pipeline development, and management using orchestration/monitoring tools.
Expert-level knowledge and experience in implementing software engineering security best practices and contributing to design/engineering for DevSecOps.
Expert-level experience with master data management strategies, rules-based engines, and tools for multi-stage data correlation on large data sets.
Must have experience managing deployment and leading the release of code to production.
Expert-level understanding of data visualization tools and requirements for business customers.Additional Skills & QualificationsExperience working and operaring effectively within an agile environment
Expert-level experience working in Jira, confluence, and contributing to engineering team documentation/playbooks.
Proven experience influencing and partnering with product management, Product Owners in translating business requirements into data and engineering specifications.
Job Type: Full-time
Pay: From $70.00 per hour
Experience level:
Schedule:
- 8 hour shift
- Monday to Friday
Experience:
- Data Engineer: 1 year (Preferred)
- SQL: 1 year (Preferred)
- Python: 1 year (Preferred)
- scala: 1 year (Preferred)
Work Location: On the road