Job Description:
You are responsible for the design, development, and maintenance of a cutting edge data
infrastructure that empower the digital bank’s vision in offering innovative financial products with frictionless customer experience that is realized through large-scale data federation, predictive and prescriptive analytics, state-of-the-art machine/deep learning, and rapid experimentation. You and your team will take full ownership of the data infrastructure under your care.
Technology stack we use:
Python, MySQL, PostgreSQL, MongoDB, Redshift, Airflow, Kafka, Spark
Key Responsibilities:
- Actively contribute towards all data engineering best practices across the Engineering function
- Collaborate with Product and Engineering teams to construct data pipelines for business reporting and application monitoring
- Collaborate with analysts and data scientists to build analytical tools based on data pipelines
- Write the best code in terms of scalability and performance of the data infrastructure
- Participate in the data solutions development process from definition to deployment
- Provide consultation to Product and Engineering teams in data processing and storage best practices
- Responsible for supporting production code to produce comprehensive and accurate data artifacts
- Senior data engineers will mentor other data engineers for both personal and professional growth
- Design, evaluate, and communicate solutions to both technical and non-technical stakeholders
Requirements:
- Bachelor Degree in Computer Science, IT or similar field
- At least 3 years of experience in data engineer role
- Proficient with data development standards and ETL processes
- Proficient with with RDBMS (MySQL, Postgres), NoSQL (MongoDB), and data warehouses (Redshift)
- Experience in building processes that support data transformation and data delivery
- Proficient with programming and scripting languages (e.g. Java and Python}
- Excellent problem solving and troubleshooting skills
- Process oriented with great documentation skills
- Familiarity with microservice architecture and domain-driven design is a plus
- Familiarity with data science techniques and frameworks is a plus
- Familiarity with Docker/Container, Container Orchestration (Kubernetes)
- Familiarity with CI/CD platforms (Jenkins, Bitbucket, Github Actions, Gitlab CI)
- Familiarity with modern cloud service provider such as AWS, Azure, and GCP