Remote Data Engineer - Big Data Pipeline Development & Engineering ($25/Hour)

• --

About arenaflex

Welcome to arenaflex, where innovation meets opportunity in the dynamic world of data engineering and logistics technology. At arenaflex, we believe that data is the lifeblood of modern enterprises, driving critical decisions that shape industries and transform businesses. As a global leader in integrated logistics and transportation solutions, we are committed to building robust, scalable, and efficient data infrastructure that powers our operations worldwide.

We are currently seeking a talented and motivated Data Engineer to join our growing Dataworks team. This is a remote opportunity that allows you to work from anywhere in the United States while contributing to meaningful projects that impact millions of shipments and customers globally. If you are passionate about data engineering, love solving complex problems at scale, and want to be part of a collaborative team that values innovation and excellence, then arenaflex is the perfect place for you to grow your career.

Our Dataworks division is the heart of data innovation at arenaflex. We are responsible for ingesting, transforming, and delivering high-quality data assets that enable analytics, machine learning, and business intelligence across the entire organization. As a Data Engineer at arenaflex, you will play a pivotal role in building and maintaining the data pipelines that fuel our operations, ensuring data quality, reliability, and performance at every step.

Job Summary

We are looking for an experienced Data Engineer who will be responsible for designing, building, testing, and maintaining data pipelines at big data scale. In this role, you will work with massive volumes of data from multiple sources, ensuring that information is properly processed, transformed, and stored efficiently. You will collaborate with cross-functional teams including IT, business analysts, data scientists, and software developers to deliver data-driven solutions that drive business value.

The ideal candidate will have a strong technical background in distributed systems, data pipeline architecture, and cloud platforms. You should be comfortable working in a fast-paced environment where you can make quick, practical decisions to improve performance and accelerate progress. This position offers excellent opportunities for career growth, skill development, and exposure to cutting-edge technologies in the big data ecosystem.

Key Responsibilities

As a Data Engineer at arenaflex, you will be responsible for the following key duties:

• Data Pipeline Development: Design, build, test, and maintain robust data pipelines capable of processing large-scale data efficiently and reliably.


• Data Ingestion: Support the ingestion of data from multiple internal and external sources, ensuring data integrity and consistency throughout the pipeline.


• Data Transformation: Develop parsers, validators, transformers, and correlators to reformat, update, and enrich data for downstream consumption.


• Data Quality Assurance: Ensure data quality by implementing validation checks, monitoring data lineage, and maintaining data governance standards.


• Performance Optimization: Investigate and resolve performance bottlenecks, optimize pipeline efficiency, and ensure scalable solutions that can handle growing data volumes.


• Troubleshooting and Support: Provide Level 3 support for data-related issues, troubleshoot complex problems, and implement corrective measures.


• Collaboration: Work closely with cross-functional teams including data scientists, business analysts, and software engineers to understand data requirements and deliver appropriate solutions.


• Documentation and Best Practices: Create and maintain technical documentation, establish best practices, and develop reusable templates and codebases for future projects.


• Code Reviews: Participate in code reviews, provide constructive feedback, and ensure adherence to coding standards and best practices.


• Mentorship: Provide guidance and mentorship to junior team members, fostering a culture of learning and continuous improvement.


• System Integration: Collaborate with senior technologists from across the enterprise and external partners to ensure smooth integration with downstream operational systems.

Essential Qualifications

To be considered for this role, candidates must meet the following requirements:

• Education: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field.


• Technical Expertise: Strong background in software engineering, database systems, and distributed computing architectures.


• Programming Skills: Proficiency in at least one programming language such as Python, Scala, or Java, with experience in data processing frameworks.


• Data Pipeline Experience: Hands-on experience designing and building data pipelines for batch and streaming workloads.


• Cloud Platform Knowledge: Familiarity with cloud platforms, preferably Microsoft Azure, and understanding of cloud-based data services.


• Database Skills: Experience with both SQL and NoSQL databases, including MySQL, PostgreSQL, Cassandra, MongoDB, or ElasticSearch.


• Big Data Technologies: Knowledge of big data tools such as Apache Spark (Scala or PySpark), HDFS, Kafka, and other high-volume data processing frameworks.


• CI/CD Experience: Understanding of continuous integration and continuous deployment practices and tools.


• Problem-Solving Skills: Strong analytical and problem-solving abilities with the capacity to troubleshoot complex technical issues.


• Communication Skills: Excellent verbal and written communication skills, with the ability to articulate technical concepts to non-technical stakeholders.

Preferred Qualifications

While not required, the following qualifications will give you a competitive edge:

• Experience in the transportation, logistics, or supply chain industry with understanding of industry-specific data challenges and opportunities.


• Advanced knowledge of Microsoft Azure services, including Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Event Hubs.


• Experience with real-time streaming data processing and near-real-time analytics scenarios.


• Proficiency in DevOps practices including infrastructure as code (Terraform), containerization (Docker, Kubernetes), and configuration management.


• Familiarity with data visualization tools and libraries such as Matplotlib, Tableau, or Power BI.


• Experience with machine learning workflows and collaboration with data science teams.


• Knowledge of data governance, data security, and compliance requirements.


• Experience working in Agile/DevOps environments with distributed teams.

Skills and Competencies

Success in this role requires a combination of technical skills and personal attributes:

• Engineering Mindset: An analytical approach to problem-solving with the ability to make quick, practical decisions to drive progress.


• Adaptability: Comfortable working in a rapidly evolving technology landscape and willing to learn new tools and technologies.


• Collaboration: Strong teamwork skills with the ability to work effectively across diverse teams and disciplines.


• Attention to Detail: Meticulous approach to data quality and accuracy in all deliverables.


• Time Management: Ability to manage multiple priorities and meet deadlines in a fast-paced environment.


• Initiative: Proactive approach to identifying improvements and implementing solutions without being asked.


• Version Control: Proficiency with Git and collaborative code development practices.

Career Growth and Learning Opportunities

At arenaflex, we are committed to the professional development of our employees. As a Data Engineer in our Dataworks division, you will have access to numerous opportunities for growth and advancement:

• Technical Leadership: Progress into senior technical roles where you will lead architecture decisions and mentor junior engineers.


• Specialization Pathways: Specialize in areas such as real-time streaming, machine learning operations, data governance, or cloud architecture.


• Cross-Functional Exposure: Work on projects that span multiple business units, gaining a comprehensive understanding of the logistics and transportation industry.


• Training Programs: Access to comprehensive training programs, certifications, and conferences to stay current with emerging technologies.


• Innovation Labs: Opportunity to participate in innovation initiatives and proof-of-concept projects that explore new technologies and approaches.


• Global Collaboration: Work with international teams and gain exposure to global data challenges and solutions.

Work Environment and Culture

arenaflex fosters a collaborative, inclusive, and innovative work environment where every team member's contributions are valued and recognized. Our culture is built on the following core values:

• Innovation: We encourage creative thinking and experimentation, fostering an environment where new ideas are welcomed and explored.


• Integrity: We conduct our business with honesty, transparency, and ethical standards in all interactions.


• Teamwork: We believe that collaboration is key to success and work together to achieve common goals.


• Customer Focus: We are committed to understanding and exceeding our customers' expectations in everything we do.


• Continuous Improvement: We constantly seek ways to improve our processes, technologies, and ourselves.

As a remote employee, you will enjoy the flexibility of working from home while staying connected with your team through modern collaboration tools. We provide the necessary technology and support to ensure you have everything you need to be successful in your role.

Compensation and Benefits

arenaflex offers a competitive compensation package that reflects your skills, experience, and contributions:

• Hourly Rate: $25.00 per hour for this position.


• Employment Type: Full-time position.


• Work Hours: 8 hours per day, Monday through Friday.


• Remote Work: Full-time remote position with flexibility to work from any location in the United States.


• Health and Wellness: Comprehensive health insurance coverage including medical, dental, and vision plans.


• Retirement Plans: 401(k) retirement savings plan with company matching.


• Paid Time Off: Generous paid time off policy including vacation, sick leave, and holidays.


• Professional Development: Reimbursement for professional certifications, training courses, and conference attendance.


• Equipment Allowance: Stipend for home office equipment and internet connectivity.

Location

This is a remote position that can be performed from anywhere in the United States. The primary work location is flexible, with the option to work from our New York office if desired. We maintain a distributed team culture with regular virtual meetings and collaboration sessions.

How to Apply

If you are ready to take the next step in your career and join a team of talented professionals who are passionate about data engineering and innovation, we encourage you to apply for this exciting opportunity.

At arenaflex, we value diversity and are committed to creating an inclusive environment for all employees. We welcome applicants from all backgrounds and experiences to join our team.

Don't miss this chance to grow your career with a leading company in the logistics and transportation industry. Apply today and become part of the arenaflex family!

Apply now to join our team at arenaflex and help shape the future of data engineering!