Autodesk Logo

Autodesk

Senior Software Engineer (Python, PySpark, Airflow, AWS)

Posted 23 Days Ago
Remote
4 Locations
Senior level
Remote
4 Locations
Senior level
As a Senior Software Engineer, you will develop and maintain batch ingestion pipelines to process large amounts of data at Autodesk. You will focus on system architecture, diagnostics of distributed systems, code reviews, and mentoring junior engineers. Your role involves creating scalable systems and contributing to team strategies and best engineering practices.
The summary above was generated by AI

Job Requisition ID #

24WD82721

Position Overview

Autodesk is looking for a Senior Software Engineer to join the Data Ingestion team within the Analytics Data organization.

The Enterprise Data Integration (EDI) team is a collection of systems and integrations focused on servicing the enterprise data needs of all data scientists, data analysts and data engineers throughout the organization.

As a Senior Software Engineer, you will be responsible for developing best practices and making architectural choices to rapidly improve critical data processing & analytics pipelines. You will collaborate with highly motivated and wonderful software engineers. You will lead and support innovative solutions to sophisticated and modern engineering problems. As part of the team, you will learn, teach, grow, and help bring data closer to our users. You will make critical choices, tackle hard problems and improve the platform’s reliability, resiliency, and scalability.

We are looking for someone who is enthusiastic about working in a team, can own and deliver long-term projects to completion. You are detail and quality oriented, and excited about the prospects of having a big impact with data at Autodesk.

Responsibilities

  • Contribute to the team’s vision and articulate strategies to have fundamental impact at our massive scale
  • You will need a product-focused mindset. It is essential for you to understand business requirements and architect systems that will scale and extend to accommodate those needs
  • Diagnose and solve complex problems in distributed systems, develop and document technical solutions and sequence work to make fast, iterative deliveries and improvements
  • Build and maintain high-performance, fault-tolerant and scalable distributed systems that can handle our massive scale
  • Ideate and drive innovative projects that will improve user experience
  • Provide solid leadership within your very own problem space, through data-driven approach, robust software designs, and effective delegation
  • Participate in, or spearhead design reviews with peers and stakeholders to adopt what’s best suited amongst available technologies.
     
  • Review code developed by other developers and provide feedback to ensure best practices (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
  • Automate cloud infrastructure, services, and observability
  • Develop CI/CD pipelines and testing automation
  • Establish and uphold best engineering practices through thorough code and design reviews and improved processes and tools
     
  • Groom junior engineers through mentoring and delegation
     
  • Drive a culture of trust, respect and inclusion within your team.
     

Minimum Qualifications

  • 5+ years of relevant industry experience in large back-end distributed systems and cloud computing.
  • Strong overall programming skills, able to write modular, maintainable code, preferably Python & SQL
  • Experience with Spark & Airflow Mandatory
  • Experience building code-driven infrastructure on public cloud platforms, preferably AWS
  • Understanding of SQL, dimensional modeling, and at least one relational database
  • Experience with automation frameworks/tools like Git, Jenkins, Ansible, and Terraform
  • Familiarity with containers and infrastructure-as-code fundamentals
  • Solid Proficiency with Amazon Web Services
  • Problem solver with excellent written and interpersonal skills; ability to make sound, complex recommendations in a fast-paced, technical environment
  • Humble, collaborative, team player, willing to step up and support your colleagues
  • Effective communication, problem solving and interpersonal skills
  • Commit to grow deeper in the knowledge and understanding of how to improve our existing applications
  • Enthusiasm for cutting edge technologies, complex problems, and building things
  • Familiar with non-functional testing such as load, performance and resiliency testing
  • Good command of English (Speaking, Writing and Reading)
  • Working in an agile environment using test driven methodologies.
  • Bachelor’s degree in Computer Science, Engineering or related field, or equivalent training, fellowship or work experience
     

Desired Qualifications

  • Experience with data processing and SQL databases
  • Experience with Hadoop / Spark Source Code
  • Experience with Map Reduce
  • Experience with Hive and/or Snowflake
  • Strong knowledge and experience in Hadoop 2.0 and its ecosystem.
  • Experience with Airflow
  • Experience with data processing and SQL databases and DBT
  • Experience in microservices based architecture

Learn More

About Autodesk
Welcome to Autodesk! Amazing things are created every day with our software – from the greenest buildings and cleanest cars to the smartest factories and biggest hit movies. We help innovators turn their ideas into reality, transforming not only how things are made, but what can be made.

We take great pride in our culture here at Autodesk – our Culture Code is at the core of everything we do. Our values and ways of working help our people thrive and realize their potential, which leads to even better outcomes for our customers.

When you’re an Autodesker, you can be your whole, authentic self and do meaningful work that helps build a better future for all. Ready to shape the world and your future? Join us!

Salary transparency

Salary is one part of Autodesk’s competitive compensation package. Offers are based on the candidate’s experience and geographic location. In addition to base salaries, we also have a significant emphasis on discretionary annual cash bonuses, commissions for sales roles, stock or long-term incentive cash grants, and a comprehensive benefits package.

Diversity & Belonging
We take pride in cultivating a culture of belonging and an equitable workplace where everyone can thrive. Learn more here: https://www.autodesk.com/company/diversity-and-belonging

Are you an existing contractor or consultant with Autodesk?

Please search for open jobs and apply internally (not on this external site).

Top Skills

Java
Python
React
SQL

Similar Jobs

Be an Early Applicant
9 Hours Ago
Tokyo, JPN
Remote
Hybrid
2,400 Employees
Senior level
2,400 Employees
Senior level
Artificial Intelligence • Cloud • Information Technology • Sales • Security • Software • Cybersecurity
As a Senior Security Solutions Engineer, you will serve as the technical point of contact, working closely with Sales teams to demonstrate Rapid7's cybersecurity solutions. Your role includes conducting product demonstrations, engaging with customers during the pre-sales process, providing technical sales training, and ensuring high client satisfaction while collaborating with internal teams and staying current with cybersecurity trends.
Be an Early Applicant
2 Days Ago
Yokohama, Kanagawa, JPN
Remote
11,000 Employees
Senior level
11,000 Employees
Senior level
Cloud • Information Technology • Productivity • Security • Software • App development • Automation
The Solutions Sales Executive will lead Jira Service Management sales efforts in Japan, develop and execute a sales strategy, drive revenue growth, and maintain relationships with top enterprise customers. Responsibilities include sales forecasting, collaboration with cross-functional teams, and representation at industry events.
Be an Early Applicant
2 Days Ago
4 Locations
Remote
1,200 Employees
Senior level
1,200 Employees
Senior level
Big Data • Cloud • Software • Database
As a Sales Engineer at Fivetran, you'll lead technical discussions with clients and support data integration solutions. You'll manage demos, respond to RFIs/RFPs, and enable staff on data concepts. This role requires expertise in data architecture and strong communication skills in both Japanese and English.

What you need to know about the Sydney Tech Scene

From opera to comedy shows, the Sydney Opera House hosts more than 1,600 performances a year, yet its entertainment sector isn't the only one taking center stage. The city's tech sector has earned a reputation as one of the fastest-growing in the region. More specifically, its IT sector stands out as the country's third-largest, growing at twice the rate of overall employment in the past decade as businesses continue to digitize their operations to stay competitive.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account