The Enterprise Cloud Team is looking for a Cloud Engineer with hands-on Microsoft Azure cloud engineering experience and required Databricks infrastructure, performance, hands-on.Job Details
- This position is for USA.
- Must be able to visit office at least once a month in corresponding location.
- Direct hire only.
- Salary range from $90 K – $125 K.
- AZ-104 or higher (REQUIRED).
Position Overview
- The ideal candidate has experience working in hybrid (cloud & on-prem) environments, and multi-cloud if possible, building and maintaining cloud group and subscription hierarchies, building and securing cloud-based infrastructure, supporting application runtime environments, architecting solutions and comfortable collaborating and communicating with engineers at all levels of the datacenter stack to implement complicated architectures and designs, while being hands-on as needed.
- The ideal candidate must be a quick learner of our infrastructure/environment, proactive in taking on tasks and not afraid to assume ownership of the tasks, end-to-end.
- The candidate must be a “do-er” not a follower and must be willing to provide commentary and opinion on just about any cloud-related topic.
Responsibilities
- Manage Databricks infrastructure and collaborate with various teams to ensure it integrates seamlessly with all components including network, security, messaging, and remote access. (REQUIRED).
- Troubleshoot and resolve Databricks environment performance issues, connectivity issues, security issues. (REQUIRED).
- Experience in setting up “Admin Group” and give user admin privileges, adding them to admins group using Admin Console, Groups API 2.0, SCIM API 2.0 or using SCIM-enabled identity provider. (REQUIRED).
- Experience as “Databricks workspace Admin”, who manage workspace users and groups including single sign-on, provisioning, access to Databricks SQL, and access control and workspace storage. (REQUIRED).
- Work with Application and Solution Architects, Software Engineers & Infrastructure Engineers to solve technical and operational challenges, drive efficiency and provide critical support for business impacting issues.
- Act as a point of escalation regarding Azure and AWS situations for the Cloud Support Team
- Support multiple systems or applications of high complexity, ensuring control, integrity and accessibility.
- Act as the technical liaison between operational and development teams, providing critical operational insight to upcoming implementations and strategies, including validation of ongoing solutions supportability.
- Stay well-informed of failures and complications related to our cloud offerings.
- Be responsible for debugging technical issues inside a complex stack involving virtualization, containers, micro-services, etc.
- Collaborate with engineering teams to enable their applications to migrate to and run on Cloud infrastructure.
- Work with automation team to maintain Automation scripts / tools created to support monitoring and automation of operational support.
- Manage and Support cloud environments in accordance with company security guidelines.
- Strong implementation and support of APIs to troubleshoot RESTful services and integration of them with consumers.
- Extensive experience with open-source technology, software development and system engineering.
- Employ exceptional problem-solving skills, with the ability to see and solve issues before they snowball into problems.
- Educate teams on the implementation of new cloud-based initiatives, providing associated training as required.
- Lead and develop best practices and runbooks for use by operations and escalations teams
- Stay current with industry trends, contributing to recommendations as needed to help the company excel.
Qualifications
- Bachelor’s Degree in Computer Science or Engineering; Master’s degree a plus.
- Certification as an Azure Solutions Architect, Cloud Security Certification, and/or OpenStack.
- 8+ years of experience in Azure cloud computing and design.
- Experience with popular solutions from the leading cloud vendors, primarily Microsoft Azure, as well as Amazon Web Services (AWS).
- Experience implementing and supporting micro-service and server-less design concepts and patterns.
- Proven design, planning and implementation experience with all infrastructure components including Storage, Network and Compute technologies.
- Experience working with Azure App Service, Azure Policy and Security Center – diagnosing and remediating resource contention issues and Identify failures in application logs.
- Experience implementing and maintaining Azure Management Group hierarchies, Subscriptions, Resource Groups, employing out-of-the-box and custom Roles and Policies to support “minimal privileges” and “separation of responsibilities (SOR).”
- Experience working with Agile methodologies supporting Infrastructure-as-a-service coding and deployment.
- Experience implementing and supporting Code/Devops and Data pipelines leveraging code repository tools such as GIT, CI/CD tools such as GitLab CI, image repositories such as Artifactory and Azure DevOps, Azure Data Flow pipelines.
- Hands-on experience with infrastructure and configuration management scripting tools and solutions – Hashicorp Terraform (required), Puppet, Chef, Ansible, CF templates, ARM.
- Experience implementing and supporting complex cloud security patterns, integrating on-premises and cloud security services, including encryption keys, certificates, PKI, CA, HSM’s, key/secrets and Key Management Vault services.
- Coding and scripting experience using PowerShell, Python, Linux command-line shells such as Bash, korn, YAML and JSON, Cloud APIs, etc.
- Comfortable coding in a polyglot environment, including Java, C/C++, NodeJS, Perl, Python, Scala, GoLang, .Net CORE.
- Experience implementing and maintaining complex authentication, authorization and single-sign-on (SSO) and federation patterns, leveraging SAML2, OAuth2/OIDC, IDaaS providers such as Okta, API Gateways, API orchestrations, and JWT’s.
- Experience debugging complex API orchestrations, synchronous and asynchronous micro-service APIs using infrastructure and application logs.
- Excellent understanding of terminology and concepts across popular public cloud services, including the “cloud computing stack,” i.e., Infrastructure as a Service (IaaS), Platform as a Service (PaaS), and Software as a Service (SaaS), as well as third-party services including Databricks, Snowflake, ElasticSearch.
- Understanding of artificial intelligence (AI), Internet of Things (IoT), and experience working with Machine Learning services such as SparkML, pySpark, Scikit, Tensor, GPUs, etc.
- Strong knowledge of Containerization technologies including Azure AKS, Redhat ARO/Openshift, Kubernetes, Docker, EKS.
- Experience implementing, securing, and supporting data analytics platforms (including Data Lakes and Data Hubs) based on Hadoop/Hive/Spark family, Cloudera, HortonWorks, SnowFlake.
- Experience implementing, securing, and supporting SQL, NoSQL and document databases, including complex queries, PL/SQL.
- Experience with implementing and automating on-premise private cloud technologies such as OpenShift, Pivotal and custom Automation tooling.
- Ability to interface with and communicate complex technical concepts to a broad range of internal and external stakeholders.
- Self-motivated and skilled at working in tandem with a team of engineers, or alone as required.
- Strong verbal and written communication skills to assist clients both internal and external and the ability to stay focused on completing tasks and meeting goals within a busy workspace.
- Time management skills with the ability to manage multiple work streams and lead and mentor less experienced engineers-Strong awareness of networking and internet protocols, including TCP/IP, DNS, SMTP, HTTP and distributed networks.
- Diagnose and troubleshoot technical issues with a variety of cloud vendors and services using cloud infrastructure and application logs.
- Experience with operating systems such as Linux, Unix & Windows.
About NPO USAIf you are smart and curious about new things, we are looking for you: this is an exciting opportunity to work, learn and acquire new skills!
