Note: The job is a remote job and is open to candidates in USA. Salesforce is the leading AI CRM company, seeking a Staff Software Engineer to join the Data Ingestion Team at Slack. The role involves designing and developing scalable streaming and batch data pipelines, implementing Lakehouse solutions, and collaborating with cross-functional partners to enhance data ingestion processes.
Responsibilities
- Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets
- Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
- Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools
- Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration)
- As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to end
- Be a role model and a multiplier, coaching and mentoring other engineers across the team and the org
- Write, review, or provide feedback on a technical design proposal from others
Skills
- U.S. citizenship and willing to undergo a background check for GovSlack authorization. We can not provide visa sponsorship for this role
- 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent
- You have hands on experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalent
- You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent
- You are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc
- You are familiar with AI-assisted software development and automation and have hands on experience of Claude Code/Codex or equivalent
- You have excellent written and verbal communication and interpersonal skills; able to effectively collaborate with cross functional partners and explaining sophisticated technical concepts to non-technical stakeholders
Benefits
- Certain roles may be eligible for incentive compensation, equity, and benefits.
- Salesforce offers a variety of benefits to help you live well including: time off programs, medical, dental, vision, mental health support, paid parental leave, life and disability insurance, 401(k), and an employee stock purchasing program.
Company Overview
Slack is a cloud-based communication and collaboration platform for teams. It is a sub-organization of Salesforce. It was founded in 2009, and is headquartered in San Francisco, California, USA, with a workforce of 1001-5000 employees. Its website is http://www.slack.com.