Senior Software Engineer - Backend (Data Lineage)

Summary

Responsibilities

• Understand and build source-specific packages focused on crawling, mining, and migrating metadata from multiple data sources.
• Work closely with field teams to unblock customers and partners during onboarding as a technical subject matter expert.
• Take full ownership of the lifecycle for multiple packages, acting as the technical owner.
• Mentor and groom junior engineers working on these packages.
• Deploy and maintain the packages on the Atlan Metadata Marketplace.
• Drive innovation and enhance developer productivity for users of Atlan.

Requirements

• 6+ years of backend development experience as an individual contributor.
• Hands-on experience with Python.
• Proven experience in data orchestration including but not limited to building and deploying data pipelines.
• Hands-on experience with ETL processes and orchestration/data transformation tools (e.g., DBT, Fivetran, Airflow, Kafka, Dagster, etc.).
• Experience leading customer and partner calls as a technical SME, with the ability to provide support for the packages you own.
• Proficiency with Kubernetes and cloud platforms (AWS, Azure, or GCP).

Work-Life Balance Benefits

• Flexible working hours.
• Remote work options.
• Supportive company culture.

Benefits

• Open-source projects.
• Growth opportunities.
• Internal team handbook for values and principles.