OaklandRecruiter Since 2001
the smart solution for Oakland jobs

Senior Data Engineer

Company: Verism Systems, Inc
Location: Oakland
Posted on: November 24, 2022

Job Description:

We are looking for a savvy Data Engineer to join our growing team of analytics experts. In this role you will work as part of cross functional teams, including data scientists, other data engineers, technology experts, and subject matter experts to develop data driven solutions. Successful candidates will be responsible for building, expanding, and optimizing our data, data storage, and data pipeline. This individual will support team members (data scientists, software developers, etc.) and decision products to ensure that data delivery is reliable and optimized. They must be self-directed and comfortable supporting the data needs of multiple teams, systems, and products. facilitative leadership this role will help the team continue its history of success. It is the perfect role for someone who would like to continue to build upon their professional experience and help advance sustainability goals.

Responsibilities:
Enhance and maintain current data pipelines and associated infrastructure
Assemble large, complex data sets that meet functional / non-functional business requirements.
Engage with different stakeholder teams to troubleshoot various database systems
Build and maintain tools that monitor data and system health
Identify, design, and implement internal process improvements to optimize production of results and enable cost savings.
Performance tune and optimize data pipeline on Spark
Create and maintain documentation describing data catalog and data objects


Minimum Requirements:
Bachelor's degree in computer science, an engineering field, or equivalent work experience in an engineering field
5 years of experience with data engineering/ETL ecosystem, such as Palantir Foundry, Spark, Informatica, SAP BODS, OBIEE


Required Skills:
Python
Pandas
APIs
Scikit Learn
PySpark or equivalent big data processing framework
Mastery of database design fundamentals
Familiarity with a CI/CD tool
Familiarity with an infrastructure as code tool
Experience writing production-level code
Experience writing health checks, unit tests, integration tests, schema validations
Knowledge of Time Series data set development.
Demonstrated commitment to teamwork and enabling others
Proven ability to translate business desires into technical requirements
Ability to communicate with various stakeholders and leadership
Ability to breakdown an ambiguous problems


Desired Skills:
Familiarity with cloud computing security fundamentals
Experience with the Palantir Foundry platform
Experience working with data scientists and machine learning engineers
Familiarity with model deployment
Front end tools: PowerBi, Tableau

Keywords: Verism Systems, Inc, Oakland , Senior Data Engineer, Engineering , Oakland, California

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category
within


Log In or Create An Account

Get the latest California jobs by following @recnetCA on Twitter!

Oakland RSS job feeds