APAC CIO Outlook
  • Home
  • CXO Insights
  • CIO Views
  • News
  • Conferences
  • Newsletter
  • Whitepapers
  • About us
Apac
  • Admired Tech

    Agile

    AI Healthcare

    Artificial Intelligence

    Augmented Reality

    Aviation

    Big Data

    Blockchain

    Cloud

    Cryptocurrency

    Cyber Security

    Digital Transformation

    Drone

    HPC

    Infrared

    Internet of Things

    Networking

    PropTech

    Remote Work

    Scheduling Software

    Simulation

    Startup

    Storage

    Wireless

  • Banking

    E-Commerce

    Education

    FinTech

    Food and Beverages

    Healthcare

    Insurance

    Legal

    Manufacturing

    Pharma and Life Science

    Retail

    Travel and Hospitality

  • Atlassian

    CISCO

    Microsoft

    Oracle

    Salesforce

    SAP

    ServiceNow

  • Business Intelligence

    CEM

    Cloud-based Planning

    Cognitive

    Compliance

    Contact Center

    Contact Tracing

    Contactless Payments

    Content Management System

    Corporate Finance

    CRM

    Custom Software Development

    Data Center

    Enterprise Architecture

    Enterprise Communications

    Enterprise Contract Management

    ERP

    Field Service

    HR Technology

    IT Service Management

    Managed Services

    Procurement

    Product Management

    RegTech

    Revenue Management

    Sales Tech

Menu
    • Augmented Reality
    • Agile
    • Cognitive
    • Cyber Security
    • Digital Transformation
    • Atlassian
    • E-Commerce
    • Managed Services
    • RegTech
    • CISCO
    • Blockchain
    • IoT
    • MORE
    #

    Apac CIO Outlook Weekly Brief

    ×

    Be first to read the latest tech news, Industry Leader's Insights, and CIO interviews of medium and large enterprises exclusively from Apac CIO Outlook

    Subscribe

    loading

    THANK YOU FOR SUBSCRIBING

    • Home
    • News
    • DevOps
    Editor's Pick (1 - 4 of 8)
    left
    Service Management in the Age of Digitization

    Douglas Duncan, CIO, Columbia Insurance Group

    Devops- 'Aligning the Future of Software Deployment'

    Herry Wiputra, CTO

    Compliance @ The Speed of Thought

    Patrick S. Kelso, Head of Devops Consulting - Anz Region, UST Global

    On the Evolution of Agile to DevOps

    Carmen DeArdo, DevOps Speaker, Consultant, Author and DevOps Leader, Nationwide

    Building the New Paradigm of Next-Gen DevOps Management

    Marc Priolo, VP, City National Bank

    A Crash Course in Low-Code Software: What it is, What it Does, Why it Matters

    Karen Astley, Vice President Asia-Pacific, Appian

    Meeting the Intelligent Data Management needs of 2019

    Shaun McLagan, Senior Vice President, Asia Pacific and Japan, Veeam Software

    Bridging the T&E Compliance Gap in a New Era of Business Travelers

    Madanjit Singh, Managing Director, South East Asia, SAP Concur

    right

    How the Importance of DevOps for Data Science is Growing

    By Apac CIO Outlook | Thursday, January 01, 1970
    Tweet

    Data science and machine learning require mathematical, statistical and data wrangling skills. While these skills are crucial for the success of implementing machine learning in an organization, DevOps for data science is gaining momentum. DevOps consists of infrastructure provisioning, continuous integration, and deployment, configuration management, monitoring, and testing.  DevOps teams and development teams have been working closely to manage the lifecycle of applications effectively.

    Data science adds further responsibility to DevOps. Data engineering, demands close collaboration of data science and DevOps because it deals with complex pipelines that transforms the data.  Operators are expected to provision highly available clusters of apache tkafka, apache hadoop, apache airflow, and apache spark.

    Data scientists use a set of tools such as jupyter notebooks, tableau, pandas, and power business Intelligence to visualize data and find insights. DevOps teams are expected to support data scientists by laying the groundwork for data visualization and exploration. The development of machine learning models is different from traditional application development because the models are iterative and heterogeneous.  A variety of popular languages are used within development environments based on jupyter notebooks, pycharm, rstudio, visual studio code, and juno.

    Machine learning and deep learning are complex processes and require massive compute infrastructure running on sturdy GPUs and CPUs. Frameworks exploit GPUs via tensorflow, apache mxnet, caffe, and microsoft cntk. The typical DevOps function is provisioning, configuring scaling, and managing these clusters. DevOps teams may have to write scripts for automation of both the provisioning of infrastructure and termination of instances when the training job is done.

    Machine learning development is iterative. New datasets train the new ML models. Continuous integration and deployment (CI/CD) best practices are applied to Machine Learning lifecycle management. DevOps teams use CI/CD pipelines to bridge the gap between ML training development and model deployment.   DevOps teams are expected to host the model in a scalable environment when a fully trained ML model is available. Machine Learning development requires containers and container management tools to be manageable and efficient.

    DevOps teams leverage containers to provision development environments, training infrastructure, processing pipelines, and model deployment environments.  Emerging tech like kubeflow and mlflow are enabling DevOps teams to handle new challenges.

    Machine learning brings newness to DevOps. A collaborative effort of developers, operators, data scientists, and data engineers is needed to embrace the new ML paradigm.

    tag

    Machine Learning

    Hadoop

    Weekly Brief

    loading
    ON THE DECK

    Retail 2021

    Top Vendors

    Compliance 2021

    Top Vendors

    Previous Next

    I agree We use cookies on this website to enhance your user experience. By clicking any link on this page you are giving your consent for us to set cookies. More info

    Read Also

    The Advantages of Blockchain in lot

    The Advantages of Blockchain in lot

    Three Benefits of Deploying Cloud Telephony System

    Three Benefits of Deploying Cloud Telephony System

    Technology Trends that Bring Revolutionary Changes in the Way Education Imparted Before

    Technology Trends that Bring Revolutionary Changes in the Way Education Imparted Before

    What Is the Role of AI in Managed Services?

    What Is the Role of AI in Managed Services?

    Four Mistakes to Avoid when Implementing Digital Transformation

    Four Mistakes to Avoid when Implementing Digital Transformation

    How Edge Computing will Address IoT Challenges?

    How Edge Computing will Address IoT Challenges?

    Loading...

    Copyright © 2021 APAC CIOoutlook. All rights reserved. Registration on or use of this site constitutes acceptance of our Terms of Use and Privacy and Anti Spam Policy 

    |  Sitemap |  Subscribe

    follow on linkedinfollow on twitter follow on rss
    This content is copyright protected

    However, if you would like to share the information in this article, you may use the link below:

    https://www.apacciooutlook.com/news/how-the-importance-of-devops-for-data-science-is-growing-nwid-5726.html