Job Description


Job Overview

  • Job ID:

    J37209

  • Job Title:

    Hadoop / Big Data Engineer

  • Location:

    Phoenix, AZ

  • Duration:

    12 Months + Extension

  • Hourly Rate:

    Depending on Experience (DOE)

  • Work Authorization:

    US Citizen, Green Card, OPT-EAD, CPT, H-1B,
    H4-EAD, L2-EAD, GC-EAD

  • Client:

    To Be Discussed Later

  • Employment Type:

    W-2, 1099, C2C

JOB DESCRIPTION:

Big Data Engineer:

This engineer will help us build an ingestion pipeline designed to get data ingested from various data bases and source systems into our new big-data environment being built on Azure.

Essential Duties and Responsibilities:

  • Day to Day support of existing data ingest jobs
  • Creation, support, and scheduling of ingestions from new sources
  • Ongoing data engineering and enhancements to data sets within the environment
  • Proficient with big data technologies
  • Hive, Pig, HBase, MapReduce
  • Experience with open source ingestion tools
  • Sqoop, Flume, Spark streaming, Kafka, Nifi
  • Proven experience building real-time steaming data sets
  • Experience working with and performing analysis using large data sets
  • 10-1000 TB
  • Familiarity with common data science toolkits, such as R, Jupyter, & Python
  • Previous experience with traditional databases such as: Netezza, MySQL, Teradata, Oracle, etc
  • Preferred Experience with Azure products: Azure Data Lake Store, Azure HD Insights, Cosmos DB, PowerBI
 
 

Apply Now
Equal Opportunity Employer

ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract


© 2013-2018. All Rights Reserved | Design by ARTIFICIAL INTELLIGENCE TECHNOLOGIES LLC