Data Engineer - Databricks Job at Open Systems Technologies, New York, NY

Njk0UTI3RmpEVjF6YlBQNjhoeFJLZzl3Mnc9PQ==
  • Open Systems Technologies
  • New York, NY

Job Description

A financial firm is looking for a Data Engineer - Databricks to join their team. This role is remote. Pay: $100-130/hr US Citizens or GC Holders Only No c2c - W2 Only Qualifications: A Bachelor's Degree in Computer Science, Management Information Systems, Computer Engineering, or related field. 7+ years of experience in designing and building large-scale solutions in an enterprise setting. 3+ years designing and building solutions in the cloud. Expertise in building and managing Cloud databases such as AWS RDS, DynamoDB, DocumentDB or analogous architectures. Expertise in building Cloud Database Management Systems in Databricks Lakehouse or analogous architectures. Deep SQL expertise, data modeling, and experience with data governance in relational databases. Experience with the practical application of data warehousing concepts, methodologies, and frameworks using traditional (Vertica, Teradata, etc.) and current (SparkSQL, Hadoop, Kafka) distributed technologies. Refined skills using one or more scripting languages (e.g., Python, bash, etc.). Embrace data platform thinking, design and develop data pipelines keeping security, scale, uptime and reliability in mind. Expertise in relational and dimensional data modeling. UNIX admin and general server administration experience. Experience with leveraging CI/CD pipelines. Presto, Hive, SparkSQL, Cassandra, or Solr other Big Data query and transformation experience is a plus. Experience using Spark, Kafka, Hadoop, or similar distributed data technologies is a plus. Experience with Agile methodologies and able to work in an Agile manner is preferred. Experience using ETL/ELT tools and technologies such as Talend, Informatica is a plus. Expertise in Cloud Data Warehouses in Redshift, BigQuery or analogous architectures is a plus. #J-18808-Ljbffr Open Systems Technologies

Job Tags

Similar Jobs

Country Club for Dogs

Dog Groomer - Guaranteed Full Appointment Schedule Job at Country Club for Dogs

 ...Country Club for Dogs is looking for a groomer. (FT/PT). Must have at least one year experience and groom all breeds. Must also be very dependable. The ideal candidate will have a love for animals and a commitment to providing exceptional grooming services. Should be... 

Arcosa

Control/Process Operator Job at Arcosa

 ...Control/Process Operator Arcosa Wind Towers is seeking a CPO in Tulsa, OK. In this role, you will roll and re-roll plate. Safety Sensitive: Yes What you will do: Roll and re-roll plate to match sweep Inspect plate for defects and damage Operate burn... 

Rhoads Industries

Pipe Welders Shop Job at Rhoads Industries

Job Description Founded and familyowned since 1896, Rhoads Industries is a total solution provider of industrial fabrication, mechanical/maintenance and maritime services. In addition to our field service and project skilled labor, Rhoads has expansive shipyard facilities...

Disability Solutions

Legal Data Services Manager Job at Disability Solutions

 ...prioritizes using the best model from today's top model creators for each individual legal use case. About the Role: The Manager of Data Services is responsible for driving strategic and operational excellence across all data quality initiatives within the InterAction... 

Roadie

Box Truck Owner Operator (Hiring Immediately) Job at Roadie

Deliver with the Roadie app this holiday season and boost your earnings! Make an averageFrom $117 - $135 per Day with just 18 Stops using the app! Payout ranges depend on delivery distance, location, and Gig size. Roadie is an easy, flexible, crowdsourced delivery...