Skip to content

The landscape of AI infrastructure

Practical AI

Hosted by Chris Benson and Daniel Whitenack

51m
Transcript

Original podcast

Where to listen

About this episode

Being that this is “practical” AI, we decided that it would be good to take time to discuss various aspects of AI infrastructure. In this full-connected episode, we discuss our personal/local infrastructure along with trends in AI, including infra for training, serving, and data management. Sponsors: DigitalOcean https://do.co/changelog – Check out DigitalOcean’s dedicated vCPU Droplets with dedicated vCPU threads. Get started for free with a $100 credit. Learn more at do.co/changelog https://do.co/changelog. DataEngPodcast https://www.dataengineeringpodcast.com?utm_source=changelog&utm_medium=podcast&utm_campaign=practicalai – A podcast about data engineering and modern data infrastructure. Fastly https://www.fastly.com/?utm_source=changelog&utm_medium=podcast&utm_campaign=changelog-sponsorship – Our bandwidth partner. Fastly powers fast, secure, and scalable digital experiences. Move beyond your content delivery network to their powerful edge cloud platform. Learn more at fastly.com https://www.fastly.com/?utm_source=changelog&utm_medium=podcast&utm_campaign=changelog-sponsorship. Rollbar https://rollbar.com/changelog – We move fast and fix things because of Rollbar. Resolve errors in minutes. Deploy with confidence. Learn more at rollbar.com/changelog https://rollbar.com/changelog. Featuring: Chris Benson – Website https://chrisbenson.com, GitHub https://github.com/chrisbenson, LinkedIn https://www.linkedin.com/in/chrisbenson, X https://x.com/chrisbensonDaniel Whitenack – Website https://www.datadan.io/, GitHub https://github.com/dwhitena, X https://x.com/dwhitenaShow Notes: Our locally installed stuff: Jupyter https://jupyter.org/Docker https://www.docker.com/Python https://www.python.org/Go https://golang.org/Postman https://www.getpostman.com/Where we see AI workflows running: AWS https://aws.amazon.com/GCP https://cloud.google.com/Azure https://azure.microsoft.com/en-us/Kubernetes https://kubernetes.io/ and KubeFlow https://www.kubeflow.org/On-prem workstations: NVIDIA https://www.nvidia.com/en-us/data-center/dgx-systems/Lambda Labs https://lambdalabs.com/System76 https://system76.com/Experimentation / model development: JupyterLab https://github.com/jupyterlab/jupyterlabGoogle Colaboratory https://colab.research.google.comAWS SageMaker https://aws.amazon.com/sagemaker/Data Science platforms: Domino https://www.dominodatalab.com/DataBricks https://databricks.com/DataRobot https://www.datarobot.com/H2O.ai https://www.h2o.ai/Pipelining and automation: Pachyderm https://pachyderm.io/Airflow https://airflow.apache.org/Luigi https://github.com/spotify/luigiModel optimization: OpenVino https://software.intel.com/en-us/openvino-toolkitTensorRT https://developer.nvidia.com/tensorrtTensorFlow Lite https://www.tensorflow.org/liteServing: MXNet https://mxnet.apache.org/TensorFlow serving https://www.tensorflow.org/tfx/guide/servingSeldon https://www.seldon.io/Monitoring/visibility: TensorBoard https://github.com/tensorflow/tensorboardNetron https://github.com/lutzroeder/netronKnock knock https://github.com/huggingface/knockknockPrometheus https://prometheus.io/ElasticSearch https://www.elastic.co/Upcoming Events: Register for upcoming webinars here https://practicalai.fm/webinars!

Transcript

0:00
51:33

9,584 words · 7 speakers

Speaker names marked are inferred from speaking time and the show’s known hosts — they are not voice-verified.

Page updated · transcript and summary are machine-generated