Data Engineer Job at I-cube Software Llc, Canada

bTJQQVYzVk1ESm5BbDJ1ZnQ2SWs0Y0RlekE9PQ==
  • I-cube Software Llc
  • Canada

Job Description

Job Description

Job Description

Hybrid Hadoop Engineer and Hadoop Infrastructure Administrator to build and maintain a scalable and resilient Big Data framework to support Data Scientists. As an administrator, your responsibility will be to deploy and maintain Hadoop clusters, add and remove nodes using cluster management and monitoring tools like Cloudera Manager, and support performance and scalability requirements, in support of our Data scientist's needs. Some Relational Database administrator experience will also be desirable to support the general administration of Relational Databases.

Design, build, and maintain Big Data workflows/pipelines to process a continuous stream of data with experience in end-to-end design and build process of Near-Real-Time and Batch Data Pipelines.


Demonstrated work experience in the following with Big Data and distributed programming models and technologies
Knowledge of database structures, theories, principles, and practices (both SQL and NoSQL).
Active development of ETL processes using Spark or other highly parallel technologies, and implementing ETL/data pipelines
Experience with Data technologies and Big Data tools, like Spark, Kafka, Hive
Understanding of Map Reduce and other Data Query and Processing and aggregation models
Understanding of challenges of transforming data across distributed clustered environment
Experience with techniques for consuming, holding, and aging out continuous data streams
Ability to provide quick ingestion tools and corresponding access APIs for continuously changing data schema, working closely with Data Engineers around specific transformation and access needs

Preferred:

Experience as a Database administrator (DBA) will be responsible for keeping critical tools database up and running
Building and managing high-availability environments for databases and HDFS systems
Familiarity with transaction recovery techniques and DB Backup

Skills and Attributes:

Ability to have effective working relationships with all functional units of the organization
Excellent written, verbal, and presentation skills
Excellent interpersonal skills
Ability to work as part of a cross-cultural team
Self-starter and Self-motivated
Ability to work without lots of supervision
Works under pressure and is able to manage competing priorities.

Hide

Job Tags

Work experience placement,

Similar Jobs

Genie Healthcare

Travel CT/MRI Radiologic Technologist Job at Genie Healthcare

 ...Job Description Genie Healthcare is seeking a travel CT Technologist for a travel job in Coquille, Oregon. Job Description & Requirements ~ Specialty: CT Technologist ~ Discipline: Allied Health Professional ~ Start Date: ASAP ~ Duration: 13 weeks ~... 

Stripe

Finance & Strategy Analyst Rotational Program Job at Stripe

 ...Please note: application window closes on January 26, 2026. About Stripe Stripe is a financial infrastructure platform for businesses. Millions of companies-from the world's largest enterprises to the most ambitious startups-use Stripe to accept payments, grow... 

Eppstein Uhen Architects

Project Architect - BIM Lead for Workplace Design Job at Eppstein Uhen Architects

 ...working with project teams, and coordinating consultants. Candidates should have a Bachelor's Degree in Architecture, experience with BIM software, and be licensed architects or possess equivalent experience. This position offers a salary between $65,000 and $95,000... 

Rise Modular

Cabinet Installer Job at Rise Modular

 ...company serving the multi-family apartment, hospitality, student housing and affordable housing sectors. Job Summary The Cabinet Installer will complete cabinet installation according to specifications. Responsibilities Install kitchen and bath cabinets,... 

Novant Health

MRI Technologist Job at Novant Health

 ...Job Description What We Offer: Novant Health is seeking an MRI Technologist to join our REMARKABLE outpatient imaging team in a collaborative, patient-focused environment. Facility: Novant Health Imaging Location: 514 South Stratford Road, Winston-Salem...