Senior Data Engineer
Company: Verism Systems, Inc
Posted on: November 24, 2022
We are looking for a savvy Data Engineer to join our growing
team of analytics experts. In this role you will work as part of
cross functional teams, including data scientists, other data
engineers, technology experts, and subject matter experts to
develop data driven solutions. Successful candidates will be
responsible for building, expanding, and optimizing our data, data
storage, and data pipeline. This individual will support team
members (data scientists, software developers, etc.) and decision
products to ensure that data delivery is reliable and optimized.
They must be self-directed and comfortable supporting the data
needs of multiple teams, systems, and products. facilitative
leadership this role will help the team continue its history of
success. It is the perfect role for someone who would like to
continue to build upon their professional experience and help
advance sustainability goals.
Enhance and maintain current data pipelines and associated
Assemble large, complex data sets that meet functional /
non-functional business requirements.
Engage with different stakeholder teams to troubleshoot various
Build and maintain tools that monitor data and system health
Identify, design, and implement internal process improvements to
optimize production of results and enable cost savings.
Performance tune and optimize data pipeline on Spark
Create and maintain documentation describing data catalog and data
Bachelor's degree in computer science, an engineering field, or
equivalent work experience in an engineering field
5 years of experience with data engineering/ETL ecosystem, such as
Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE
PySpark or equivalent big data processing framework
Mastery of database design fundamentals
Familiarity with a CI/CD tool
Familiarity with an infrastructure as code tool
Experience writing production-level code
Experience writing health checks, unit tests, integration tests,
Knowledge of Time Series data set development.
Demonstrated commitment to teamwork and enabling others
Proven ability to translate business desires into technical
Ability to communicate with various stakeholders and leadership
Ability to breakdown an ambiguous problems
Familiarity with cloud computing security fundamentals
Experience with the Palantir Foundry platform
Experience working with data scientists and machine learning
Familiarity with model deployment
Front end tools: PowerBi, Tableau
Keywords: Verism Systems, Inc, Oakland , Senior Data Engineer, Engineering , Oakland, California
Didn't find what you're looking for? Search again!