Join arenaflex, a leading logistics and transportation company, as we seek enthusiastic and talented individuals to fill immediate openings in our data engineering team. As a data engineer at arenaflex, you will play a vital role in designing, developing, and maintaining large-scale data pipelines, working closely with cross-functional teams to drive business growth and innovation.
**About arenaflex**
arenaflex is a global leader in logistics and transportation, with a rich history of innovation and customer satisfaction. Our company is built on a strong foundation of teamwork, collaboration, and a passion for delivering exceptional results. As a data engineer at arenaflex, you will be part of a dynamic and fast-paced team that is shaping the future of logistics and transportation.
**Key Responsibilities**
As a data engineer at arenaflex, your key responsibilities will include:
* Designing, developing, and maintaining large-scale data pipelines to support business growth and innovation
* Collaborating with cross-functional teams to drive business outcomes and deliver exceptional results
* Developing and implementing data engineering solutions to support data-driven decision-making
* Working closely with data scientists and analysts to develop and deploy machine learning models and predictive analytics
* Ensuring data quality, integrity, and security across all data pipelines and systems
* Troubleshooting and resolving complex technical issues related to data engineering and data science
* Developing and maintaining technical documentation and knowledge base for data engineering and data science teams
* Collaborating with senior technologists and data scientists to develop and implement new technologies and solutions
**Unexpected Expected Set of Responsibilities**
As a data engineer at arenaflex, you will also be expected to:
* Work closely with data architects to design and develop data models and data warehouses
* Collaborate with data scientists to develop and deploy machine learning models and predictive analytics
* Develop and maintain data engineering solutions to support data-driven decision-making
* Work closely with business stakeholders to understand business requirements and develop solutions to meet those needs
* Collaborate with cross-functional teams to develop and implement new technologies and solutions
**Fundamental Work Obligations and Obligations**
As a data engineer at arenaflex, your fundamental work obligations and obligations will include:
* Understanding both the business and technical issues that data engineering solutions aim to address
* Building tools, platforms, and pipelines to enable teams to clearly and neatly investigate data, build models, and drive decisions
* Scaling from "PC scale" to "team scale" issues, in terms of both infrastructure and problem design and method
* Collaborating across teams to drive the creation of data-driven functional insights that yield high-value improved solutions
* Delivering clear and actionable value quickly, collaborating with diverse teams of varying backgrounds and disciplines
* Classifying best practices for future reuse as available, reusable examples, templates, and code bases
* Engaging with senior technologists from the broader project and beyond arenaflex (partner environments and clients) to create collaborative energies and ensure smooth handoffs to downstream functional systems
**Expertise/Information Thought about an Or more**
To be successful as a data engineer at arenaflex, you will need:
* A strong foundation in software engineering, programming, database systems, and distributed systems
* Familiarity with distributed and cloud environments and a deep understanding of enhancing computational considerations with theoretical properties
* Experience in building robust cloud-based data engineering and curation solutions to make data products useful for various applications
* In-depth knowledge of the Microsoft Azure tooling for large-scale data engineering endeavors and solutions is highly preferred. Experience with any combination of the following Azure tools: Azure Databricks, Azure Data Factory, Azure SQL Data Warehouse, Azure Machine Learning
* Creating and operationalizing functions and solutions including under close to real-time high-volume streaming circumstances
* Active development skills with the ability to work at the code level and help troubleshoot hard-to-resolve issues
* A compelling history of planning and delivering large-scale technical solutions that convey clear, ongoing value
* Direct experience having built and delivered strong, complex production systems that execute current, data processing strategies at scale
* Ability to set switch, to offer support to distributed teams which may require a "specialized programmer" to unblock a particularly difficult technical obstacle, and to figure out through issues as they are still being defined
* Demonstrated ability to deliver technical projects with a team, frequently working under close time constraints to deliver value
* An "engineering" attitude, able to make fast, practical decisions to improve performance, accelerate progress or amplify impact
* Comfort with working with distributed teams on code-based expectations, using version control systems and code reviews
* Ability to lead data analysis, investigation, and heredity studies to record and upgrade data quality and access
* Utilization of agile and devops practices for project and software management including continuous integration and continuous delivery
**Shown mastery working with some of the following common languages and tools:**
* Spark (Scala and PySpark), Kafka and other high-volume data tools
* SQL and NoSQL storage tools, like MySQL, Postgres, MongoDB/CosmosDB
* Java, Python data tools
* Azure DevOps experience to follow work, develop using git-integrated version control examples, and build and use CI/CD pipelines
* Working knowledge and experience executing data engineering patterns to support shifting business needs
* Experience with various data types (json, xml, parquet, avro, unstructured) for both batch and streaming ingestions
* Utilization of Azure Kubernetes Services, Eventhubs, or other related advancements to execute streaming ingestions
* Experience creating and implementing warning and monitoring systems
* Working knowledge of Infrastructure as Code (IaC) through Terraform to create and deploy assets
* Execution experience across various data stores, messaging frameworks, and data processing engines
* Data joining through APIs as well as REST service
* PowerPlatform (PowerBI, PowerApp, PowerAutomate) development experience an or more
**Least Capabilities:**
**Information Architect I:**
* Four-year college education in Data Systems, Software engineering or a quantitative discipline like Math or Designing or potentially One (1) year comparable conventional preparation or work insight
* Essential knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Essential knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
* Experience as a junior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might counterbalance the connected experience prerequisites
**Sponsorship isn't accessible for Information Designer I job.**
**Information Specialist II:**
* Four-year certification in Software engineering, Data Systems, a connected quantitative field, for example, Designing or Math or identical proper preparation or work insight
* Two (2) years comparable work insight in estimation and examination, quantitative business critical thinking, reproduction improvement and additionally prescient examination
* Solid knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Solid knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and developing advancements
* Experience as a member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might balance the connected experience prerequisites
**Sponsorship isn't accessible for Information Architect II job.**
**Information Designer III:**
* Four-year college education in Data Systems, Software engineering or a quantitative discipline like Math or Designing as well as comparable conventional preparation or work insight
* Three to Four (3 - 4) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
* Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Broad knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and advancing advancements
* Experience giving authority in a general preparation or counseling setting
* Experience as a senior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might counterbalance the connected experience necessities.
**Information Designer Lead:**
* Four-year college education in Data Systems, Software engineering, or a quantitative discipline like Science or Designing as well as identical conventional preparation or work insight
* Five to Seven (5 - 7) years identical work insight in estimation and examination, quantitative business critical thinking, recreation improvement or potentially prescient examination
* Broad knowledge in data engineering and AI structures including plan, development and execution of highly complex frameworks and data pipelines
* Broad knowledge in Data Systems including plan, development and execution of large cluster or online transaction-based frameworks
* Solid comprehension of the transportation business, contenders, and developing advancements
* Experience giving initiative in a general preparation or counseling setting
* Experience as a leader or a senior member of multi-functional project teams
* Solid oral and written communication skills
* A connected postgraduate education might balance the connected experience necessities.
**Residence/Movement Data:**
* This position can be domiciled anywhere in the US.
**Application Standards:**
* Transfer current copy of Resume (Microsoft Word or PDF format only) and answer work screening survey.
**Extra Data**
Colorado, Nevada, Connecticut, New York, California, Rhode Island, Washington, Hawaii, Illinois and New Jersey Residents Only - Remuneration: Monthly Pay: $6,317.00 - $15,477.00. This pay range is provided as a reasonable estimate of the current starting salary range for this job. Factors that may be used to determine your actual salary may include your education, experience, and performance.
**Top 10 Interview Questions**
* Can you tell us about yourself?
* What interests you about this position?
* What are your strengths?
* What are your weaknesses?
* Can you give an example of a time when you solved a problem creatively?
* How do you handle stress and pressure?
* How would you describe your work style?
* Can you tell us about a time when you had to work with a difficult colleague or supervisor?
* How do you stay organized and prioritize tasks?
* What are your long-term career goals?
**Document Required:**
* Required Documents for This Recruitment: The candidate should have this Document Before Apply Online. Candidates Are Suggested To Read the Official Notification Before Applying.
* Document – Qualifications certificate with mark sheets.
* Passport size Photographs
* Signature
**How to apply:**
* All the eligible candidates can apply for This Job as mentioned below
* Read the official notification carefully From the Official Website.
* Read the Notification Carefully Before Applying.
* Fill out The Application Form (The link Is Given Below)
* Attach the Required Document and Passport Size Photo with Signature.
* Then Submit. Done.