Job Description
SENIOR DATA ENGINEER
quarter for a few days (approximately a week). Exact dates and location to be confirmed.
Overview
Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of professionals, and educational opportunities with leading technology providers.
At Andela, we’re deeply passionate about creating long-lasting and transformative growth opportunities for all – and doing it in an E.P.I.C. way! We’re excited to continue building our remote-first team with incredible people like you. After applying for this role, you will join our Andela Community of brilliant technologists by passing a technical screening and live interview. As a community member, you’ll have access to many exclusive technologist roles. Join Andela today to access this opportunity and more in our global marketplace!
One of our clients is looking for a Data Engineer to join their Data and AI Team and apply data engineering expertise as we continue to reimagine how data drives our future business. In this position you will partner with data scientists, business stakeholders, and team members to design, build, and operationalize strategic data platforms and processes.
Important: this role requires in-person work once a quarter for a few days (approximately a week). Exact dates and location to be confirmed.
Responsibilities
- Participate in the design and implementation of sophisticated software systems using either object-oriented or functional programming techniques implemented in Python (preferred), Go, Java or Scala languages.
- Participate in software design and code reviews. Reviews include other Software Engineers and are held to ensure a high level of software quality and to share knowledge with team members.
- Participate in, and adhere to, professional software engineering practices using such tools and methodologies as Agile Software Development, Test Driven Development, Continuous Integration, Source Code Management (git), Jira, and Stash
- Maintain a high level of proficiency with Computer Science/Software Engineering knowledge and contribute to the technical skills growth of other team members.
- Work well independently and as part of a team.
Qualifications
- Bachelor’s degree in Computer Science, or comparable work experience
- Experience operating and deploying solutions using AWS Service including S3, EMR, SQS, SNS, Lambdas, Athena, Glue, Kinesis and MSK.
- Python production level coding, including best practices
- Big data technologies such as Cassandra, Spark, Hadoop, Parquet, Redash, etc.
- Proficient with building data integrations using both API and file based protocols.
- Proficiency with test-driven development and unit testing.
- Proficiency with Git Version Control.
- Experience with CI/CD pipeline patterns and best practices
- Experience with alerting and monitoring tools like Grafana
- Solid experience implementing high availability, scalable cloud solutions
- Strong understanding of data structures and algorithms
- Knowledge of functional programing languages and techniques
- Knowledge of object-oriented programming languages and techniques
- Solid understanding of concurrency and concurrent programming techniques
- Solid understanding of distributed computing techniques
- Knowledge and understanding of operating with data in large scale
- Must desire to learn new technologies and languages.
- Able to put together process documentation concisely and clearly.
- Excellent written and verbal communication skills.
- Able to work closely and effectively with peer developers and work on several active projects simultaneously.
Required Qualifications
- One or more of the following programming languages: Scala, Java, Clojure, and/or Go.
- Basic understanding of Machine Learning and Data Science concepts
- Certification in cloud platforms such as AWS, GCP, and/or Azure.
Location: Nigeria (Remote)
Apply: SENIOR DATA ENGINEER