Job Description

We are looking for a talented and motivated Software Engineer to join our team on a contract basis. In this role, you'll be working on key projects, including creating and maintaining API interfaces, ingesting and transforming data, and collaborating with other developers to ensure seamless functionality across our systems. If you're a skilled Python developer with experience in SQL, cloud computing, and a passion for working with cutting-edge technologies, we encourage you to apply!
What You'll Be Doing:

Primary Responsibilities:
Develop and update API interfaces to connect with MySQL backend databases. The API will be hosted on AWS ECS and written using Python.
Ingest data from various databases and file sources into the Enterprise Data Lake.
Transform data and create common tables using PySpark and SQL.
Load transformed data into MySQL from the Enterprise Data Lake.
Analyze data using SQL and PySpark.
Maintain and update AWS resources.

Supporting Responsibilities:
Collaborate with the front-end developer to define the API specifications.
Build test scripts in Python to validate data replication processes.
Work closely with the product manager and end-users to gather requirements and ensure a smooth development process.

What We're Looking For:

Required Skills:
3-5 years of experience working with SQL, Python, and cloud computing (AWS preferred).
Proficiency in Python, SQL, and PySpark.
Solid understanding of AWS services, including IAM, Lambda, S3, RDS, ECS, and EC2.
Hands-on experience developing jobs and pipelines in Databricks.
Knowledge of Docker and containerization concepts, as well as REST API development using Python.

Additional Skills:
Experience with Terraform, Github Actions, Datadog, AWS Database Migration Service, Apache Airflow, and REST API development in Python is a plus.

Why Join Us?
You'll have the opportunity to work on exciting and impactful projects in a collaborative, remote work environment. We encourage innovation and creative problem-solving and are committed to providing support as you grow in your role. This position is perfect for someone who thrives in a fast-paced, dynamic setting and enjoys working with a team to deliver high-quality results.
Employment Type: Contractor
Salary: $ 66,000.00 168,000.00 Per Year

Job Tags

For contractors, Remote job,

Similar Jobs