Note: The job is a remote job and is open to candidates in USA. Augusta Hitech is seeking an experienced Senior Data Integration Engineer to design, develop, and maintain scalable data pipelines and optimize data storage solutions. The role involves working with cloud platforms, big data technologies, and ETL processes to support business intelligence and analytics.
Responsibilities
- Design and implement scalable data pipelines using Python, PySpark, and Big Data tools
- Optimize data processing performance in AWS
- Collaborate with business teams to deliver reliable data solutions
- Develop and maintain ETL processes using tools like Airflow, Azkaban, and AWS Glue
- Troubleshoot and ensure data integrity across data pipelines
- Mentor junior team members and promote best practices
Skills
- 5+ Years of experience
- Design and implement scalable data pipelines using Python, PySpark, and Big Data tools
- Optimize data processing performance in AWS
- Collaborate with business teams to deliver reliable data solutions
- Develop and maintain ETL processes using tools like Airflow, Azkaban, and AWS Glue
- Troubleshoot and ensure data integrity across data pipelines
- Mentor junior team members and promote best practices
- Strong experience with Python, PySpark, SQL, AWS (Redshift, Glue, S3)
- Expertise in big data technologies (Hadoop, Hive, Spark)
- Proficient in data modeling and ETL orchestration
- Experience with business intelligence tools (Tableau, Power BI)
- Strong problem-solving and communication skills
- Any Degree
Company Overview
Augusta Hitech develops high-complexity integrated technology systems with the expertise of a global leader and the efficiency of a young company propelled by innovation. It was founded in 2009, and is headquartered in West Lafayette, Indiana, USA, with a workforce of 201-500 employees. Its website is https://coffective.com.