Remote Senior Data Engineer - Big Data Pipeline Architecture, Cloud Infrastructure & Real-Time Data Processing

Join arenaflex as a Senior Data Engineer

Are you passionate about building scalable data infrastructure that powers business intelligence and drives strategic decision-making? arenaflex is looking for an experienced Senior Data Engineer to join our dynamic technology team and help shape the future of our data platform. This is a unique opportunity to work with cutting-edge technologies, collaborate across multidisciplinary teams, and make a significant impact on how arenaflex leverages data to deliver exceptional results.

At arenaflex, we believe that data is the cornerstone of innovation in today's fast-paced digital landscape. As a Senior Data Engineer, you will be instrumental in designing, building, and maintaining the data pipelines that enable our organization to transform raw data into actionable insights. You'll work alongside talented engineers, data scientists, and business stakeholders to create robust data solutions that support both internal operations and customer-facing products.

Position Overview

We are seeking a highly motivated and skilled Senior Data Engineer to oversee the design, development, testing, and maintenance of large-scale data pipelines within our enterprise data ecosystem. In this role, you will be responsible for ensuring the efficient flow of data from multiple sources, transforming it into usable formats, and making it available for analysis and decision-making purposes. You will provide technical leadership, mentor junior team members, and collaborate with cross-functional teams to deliver high-value data solutions that meet business objectives.

Key Responsibilities

• Pipeline Design and Development: Architect, build, test, and maintain robust data pipelines capable of processing data at scale, ensuring high availability, reliability, and performance across all data operations.


• Data Integration: Lead efforts to ingest, transform, and integrate data from diverse sources including structured and unstructured data stores, APIs, streaming platforms, and third-party systems.


• Quality Assurance: Implement data validation, testing, and quality control measures to ensure data accuracy, consistency, and integrity throughout the pipeline lifecycle.


• Performance Optimization: Monitor pipeline performance, identify bottlenecks, and implement optimization strategies to enhance processing speed and efficiency.


• Troubleshooting and Support: Provide Level 3 technical support for complex data-related issues, conducting thorough root cause analysis and implementing sustainable solutions.


• Code Development: Develop parsers, validators, transformers, and correlators to reformat, update, and enrich data as it moves through the pipeline ecosystem.


• Documentation and Best Practices: Create and maintain comprehensive technical documentation, establishing best practices, reusable templates, and standardized codebases for future team use.


• Team Collaboration: Act as a technical mentor and guide for junior engineers, providing leadership and fostering professional growth within the data engineering community.


• Stakeholder Engagement: Serve as a bridge between IT, business units, data scientists, and external partners, translating business requirements into technical solutions.


• Cloud Infrastructure: Leverage Microsoft Azure and other cloud platforms to design and deploy scalable data solutions that meet current and future business needs.

Essential Qualifications

• Educational Background: Bachelor's degree in Computer Science, Software Engineering, Information Technology, or a related technical field. Advanced degrees are a plus but not required.


• Technical Expertise: Strong foundation in software engineering, programming, database systems, and distributed computing architectures.


• Cloud Experience: Demonstrated hands-on experience with Microsoft Azure cloud services, including data storage, compute, and analytics offerings.


• Data Pipeline Experience: Proven track record of building and operating CI/CD pipelines for data engineering workflows using tools like Azure DevOps, Jenkins, or similar platforms.


• Programming Proficiency: Strong coding skills in languages such as Python, Scala, or Java, with experience in data processing frameworks like Apache Spark (PySpark).


• Database Knowledge: Working familiarity with both SQL and NoSQL database systems including MySQL, PostgreSQL, Cassandra, MongoDB, and Elasticsearch.


• Big Data Technologies: Experience with distributed data processing tools such as HDFS, Kafka, and other high-volume streaming platforms.


• DevOps Practices: Solid understanding of infrastructure as code, with proficiency in scripting, YAML, JSON, and tools like Terraform.


• Analytical Thinking: Strong problem-solving abilities with an engineering mindset that embraces rapid, data-driven decision making.


• Communication Skills: Excellent verbal and written communication skills, with the ability to articulate complex technical concepts to diverse audiences.

Preferred Skills and Experience

• In-depth understanding of the transportation and logistics industry, with the ability to identify high-opportunity areas for data-driven innovation.


• Experience building and operationalizing real-time streaming data processing solutions under high-volume conditions.


• Familiarity with machine learning workflows and tools such as TensorFlow, Scikit-Learn, and Jupyter notebooks for data analysis and model development.


• Background in data visualization and analytics tools including Matplotlib, Tableau, or Power BI.


• Experience working with agile methodologies and cross-functional teams in a fast-paced, deadline-driven environment.


• Knowledge of data governance, security best practices, and compliance requirements relevant to enterprise data management.


• Experience collaborating with external partners and clients to ensure seamless integration with downstream operational systems.

What We Offer

At arenaflex, we recognize that our employees are our most valuable asset. We are committed to providing a comprehensive compensation package that includes competitive salaries, performance-based bonuses, and a range of benefits designed to support your professional and personal well-being.

• Competitive Compensation: Attractive hourly rate of $25 per hour with opportunities for overtime and performance-based increases.


• Health and Wellness: Comprehensive health insurance coverage including medical, dental, and vision plans, along with mental health support programs.


• Retirement Benefits: 401(k) retirement plan with company matching contributions to help you save for the future.


• Professional Development: Access to continuous learning opportunities, technical certifications, and training programs to enhance your skills and career growth.


• Work-Life Balance: Flexible work arrangements, generous paid time off, and remote work options to support your lifestyle.


• Career Advancement: Clear career progression paths and internal mobility opportunities within arenaflex's growing technology organization.


• Innovation Culture: An environment that encourages experimentation, creativity, and the freedom to explore new technologies and approaches.

Work Environment and Culture

arenaflex fosters a collaborative, inclusive, and innovative work environment where every team member is valued and empowered to make a difference. We embrace diversity in thought and background, recognizing that it drives better solutions and fuels innovation. Our culture is built on trust, transparency, and a commitment to excellence.

As a Senior Data Engineer at arenaflex, you'll have the opportunity to work on challenging projects that push the boundaries of what's possible with data. You'll collaborate with talented professionals across various disciplines, including software engineering, data science, business analysis, and product management. Our teams embrace agile methodologies and continuous improvement, ensuring that we deliver value quickly while maintaining high quality standards.

We support remote work arrangements, giving you the flexibility to work from our New York office or the comfort of your home office. Our distributed teams stay connected through modern collaboration tools, regular team meetings, and ongoing communication platforms.

Career Growth Opportunities

arenaflex is invested in the long-term career development of our employees. As a Senior Data Engineer, you'll have access to mentorship programs, leadership training, and technical specialization tracks. We encourage our team members to explore different areas of the business, take on new challenges, and grow into roles that align with their interests and aspirations.

Beyond technical growth, you'll develop strong business acumen by working closely with stakeholders across the organization. This exposure will help you understand how data engineering translates into business value, preparing you for future leadership roles within arenaflex.

Join Our Team

If you're ready to take your data engineering career to the next level, we encourage you to apply for this exciting opportunity at arenaflex. We're looking for passionate individuals who are eager to innovate, collaborate, and make an impact. Bring your technical expertise, creative problem-solving skills, and enthusiasm for data to arenaflex, and help us build the data infrastructure that powers our continued success.

Apply today to join our team of dedicated professionals and become part of a company that values innovation, teamwork, and personal growth. We can't wait to see what you'll accomplish at arenaflex!

arenaflex is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, sexual orientation, gender identity, national origin, disability, or veteran status.