The Kubernetes AI Toolchaining Operator (AKS) features a RAG engine that enables users to interact with private documents using a hosted language model, like Phi-4. This tool allows for grounded AI responses by indexing and retrieving relevant data. This is an AI platform offering management control and scalability supporting many Gen AI applications.
This blog post discusses setting up a chatbot UI using Streamlit alongside a deployed language model inference service in Azure Kubernetes. It details the process of testing the inference service with curl commands, implementing a Streamlit app, and configuring ingress rules for external access, highlighting Streamlit's user-friendly capabilities for chatbot development.
The Kubernetes AI Toolchain Operator (KAITO) automates AI/ML model processes in Kubernetes, enhancing control and security. This setup involves creating an AKS cluster, installing KAITO, and configuring an Nginx ingress for public model access, showcasing actionable AI solutions.
I have a Windows 11 PC and use Visual Studio Code connected to Windows Subsystem for Linux (WSL). Occasionally, I wake up my PC from sleep mode. I then try to reconnect to WSL from VS Code. And I would get the following error. Failed to connect to the remote extension host server (Error: WebSocket …
Continue reading Visual Studio Code “Failed to Connect to the remote Extension host server”
When creating an indexer in Azure AI Search to read files such as JSON and PDFs, I encountered the following error: Operation:Web Api response status: 'Unauthorized', Web Api response details: '{"error":{"code":"PermissionDenied","message": "Principal does not have access to API/Operation."}}' Message:Could not execute skill because the Web Api request failed. Details:Web Api response status: 'Unauthorized', Web Api …
Continue reading Resolving Errors In Azure AI Search Indexer Against Blob Storage Account
The Azure Naming terraform module provides a consistent way to generate resource names that adhere to established conventions in Azure deployments. This tool facilitates unique naming for resources, particularly useful for ensuring no conflicts in various subscriptions or regions, enhancing organization and efficiency in Terraform projects.
I have been testing out the Azure Verified Module for Azure Kubernetes Service that can be found in the Terraform Registry at https://registry.terraform.io/modules/Azure/avm-res-containerservice-managedcluster. This module came out in October 2024 so its fairly new. This module is suitable for enterprise-grade production environments, applies Microsoft best practices, features RBAC, complex monitoring. Also it is supported by …
Continue reading Exploring Azure Verified Module for Azure Kubernetes Service
I came across the Azure Verified Module for Azure Kubernetes Service and in its Github repo I found a Well Architected Framework (WAF) Aligned example for deploying this Terraform module. So asked myself, "What exactly makes this example of deploying AKS WAF Aligned?" Before I get into that, let me explain what is WAF. It …
Continue reading Well Architected Framework With The Azure Verified Module For Azure Kubernetes
I have been trying out the Azure Verified Module avm-res-storage-storageaccount. module's repo: https://github.com/Azure/terraform-azurerm-avm-res-storage-storageaccount/tree/main Hashicorp Terraform Registry: https://registry.terraform.io/modules/Azure/avm-res-storage-storageaccount/azurerm/latest?tab=inputs I like show some simple networking scenarios in the Firewalls and Virtual networks configuration in terms of this modules parameters. This configuration is found at The module input parameters to discuss are the following: public_network_access_enabled bool Description: (Optional) Whether the …
Continue reading Azure Verified Module Storage Account: Firewalls and Virtual Network Configuration
As I was starting to try out Azure Foundry Safety and Security feature, I confronted with the error "Your account does not have access to this resource, please contact your resource owner to get access". And so I went to the Management Center, to check user permissions and yet I have owner permissions at the …
Continue reading Permissions with Azure AI Foundry: Safety And Security
Roy Kim on Azure and AI 