Overview Job Description: As a Data Engineer, you will be the central architect for backend development ETL projects, responsible for ensuring a reliable, optimized data pipeline. You will also collaborate closely with our Directors and Managers to ensure they have access to the reports and data that are critical for their diverse needs. This requires understanding many aspects of the business and the systems that drive them, including: ecommerce, manufacturing, and fulfillment.

This role offers a unique opportunity to engage in meaningful projects, and solve critical challenges. You will drive initiatives that empower departments with data, automated manual reporting, and enable our adoption of AI in innovative ways. While you will gain exposure to transformative AI projects, your primary focus will be on developing a robust data lake that facilitates reporting and analysis.

The Data Engineer is a fully onsite role in Columbus, Ohio. Remote work is not available. Applicants must be authorized to work in the United States for any employer.

Responsibilities

Maintain efficient data pipelines, addressing data challenges such as inconsistency, quality issues, and complex transformation
Ingest internal and external data into the bronze layer
Collaborate with the team to understand pipeline structure and mechanize ad hoc data streams
Transform raw data into clean and optimized usable building blocks in the silver layer
Work with departments to understand business needs and prepare and format data for reporting purposes in the gold layer
Utilize GCP services such as Cloud Scheduler and Cloud Functions
Develop comprehensive testing strategies to ensure data integrity and pipeline functionality using Python notebooks. Collaborate closely with the Data Manager to design and execute data reporting pipelines
Lead technical project development with a high degree of autonomy, owning key tech improvements such as writing Python SDKs and researching efficient methods of data transformation

Qualifications

2-5 years of relevant data engineering experience
Bachelor’s degree in Computer Science or a related field
Proficiency in Python and its data-related libraries (Pandas, NumPy, SciPy)
2 years of experience designing and optimizing complex SQL pipelines in GCP
Experience as a lead developer defining project requirements
Experience working with diverse databases, including e-commerce
Experience ingesting data from diverse APIs
Experience with version control using Git
Excellent communication skills and problem-solving abilities
Demonstrated ability to work independently and collaboratively
High attention to detail, particularly with data security best practices
Experience working with infrastructure as code tools such as Terraform
Experience developing SDKs for data ingestion workflows

By applying to Rogue, regardless of the platform you choose to use, you are agreeing to Rogue's preferred methods of communication (i.e. text message). Submitting an application, through whatever online forum is ultimately used, constitutes a knowing and voluntary agreement to send and receive text messages during the recruitment process.

Data Engineer

Job description