Getting Started with Microsoft Foundry: Complete Setup Guide and First Steps

Microsoft Foundry is Microsoft’s unified platform for building, managing and deploying AI solutions. It is a platform-as-a-service that provides tools and services for complete AI end-to-end lifecycle management. It helps developers and data scientists to collaborate. It supports traditional Generative AI and ML Models.

• This foundation is built on top of production-quality infrastructure and user-friendly interfaces.
• It allows developers to concentrate on developing the application and not be responsible for the infrastructure.
• Microsoft Foundry integrates agents, models, and tools within a single grouping for enterprise management, and provides built-in enterprise readiness features such as tracing, monitoring, evaluations and customizable enterprise setup configurations. 
• A unified role-based access control (RBAC), networking, and policies are provided under one Azure resource provider namespace, making the platform easier to manage.

In simple words, Microsoft Foundry is a platform from Microsoft that helps you build, test, and deploy AI applications in one place. Instead of using different tools for models, data, monitoring, and security, everything is available in a single platform.

Why Use Azure AI Foundry?

• We can access AI models, build applications, test them, and deploy them, the complete end-to-end solution without switching between multiple services.
• We can have access to many more models from OpenAI, Claude AI, Grok AI, Mistral AI, DeepSeek, and Microsoft models, and we can choose the one which fits to our use case.
• We can create agents that can connect to SharePoint, databases, APIs, and other enterprise systems.
• Microsoft Foundry has ready to use templates to start quickly with chatbots, document analysis, code generation, and many more.
• Vector stores and retrieval-augmented generation (RAG) allow your AI solution to answer questions based on your own documents and company data.
• Optimize models using data from your own business to get better results. Monitor model responses, performance, and mistakes to gain insights into the behavior of your AI application.
• Security, compliance, and responsible AI controls come with the enterprise grade security from the beginning.
• Scale and transition from a small prototype to a production-ready enterprise application on the same platform.

The Microsoft Foundry model landscape (who’s who)

AI Model Providers

Step-by-Step Setup Guide

Follow the complete Blog to get started with Microsoft Foundry

1. Log in to the Azure Portal. Visit portal.azure.com and sign in with your Azure account. If you don’t have one, you can create a free trial account.

2. Create a Resource Group Resource Groups act as containers for your Azure resources.

• Search for “Resource groups” in the portal.
• Click Create.
• Give it a meaningful name (e.g., "Microsoft Foundry").
• Choose a region. I used East US 2 (or a similar region) because it often has better availability for the latest AI models.
• Review and create the resource group.

3. Deploy Microsoft Foundry

• Inside your new resource group, click Create and search for "Microsoft Foundry".
• Follow the deployment process: Select your subscription and the resource group you have created. Provide a name for your Microsoft Foundry instance. Choose the appropriate region.
• Review the settings and deploy. Deployment may take a few minutes.

Once you create the Microsoft Foundry, you will see 2 options

• Foundry = Main workspace that manages AI resources and settings.
• Foundry Project = Actual working area where you build and test AI applications. 

4. Access the Microsoft Foundry dashboard. Once the deployment is completed, open your Foundry resource. Here, you’ll see the overview page containing important details such as:

• Endpoints and API keys (essential for connecting your applications).
• Subscription and billing information.
• Quick links to key sections.

Endpoints and API keys

Exploring Key Features in Microsoft Foundry

After setup, the platform opens up a rich set of capabilities:

• Model Catalog – Browse and deploy a wide variety of models, including GPT-series from OpenAI, Grok, Mistral, and Microsoft’s Phi and other foundation models from the Foundry portal.

• Playgrounds – Experiment with chat, image generation, audio, and other modalities without writing code. This is great for rapid prototyping.

• Agents – We can build intelligent agents that can use tools, connect to MCP servers, SharePoint, Logic Apps, databases, and more.

• Templates – You can also quickly get started with prebuilt templates for use cases like chatbots, code modernization, and other business solutions. Just pick a template based on your need, customize it, and start building without doing everything from scratch. 

• Fine-Tuning Customize models with your own industry-specific data to improve performance on domain tasks.

• Monitoring we can monitor usage, performance and costs in real time of our applications.

• Evaluation Evaluate the performance and safety of our AI models and agents.

Under Evaluation, there is an option of Evaluator Library, which is a collection of prebuilt testing tools that are used to measure how good, safe, and accurate our AI application is.

Why Is It Used?

Suppose you build:

• Chatbot
• RAG application
• Copilot
• Q&A assistant 

Now you need to check:

• Is the answer correct?
• Is the response relevant?
• Is harmful content generated?
• Is grounding proper?
• Is hallucination happening? 

The Evaluator Library helps measure all this automatically.

Example

If your chatbot answers:  "The capital of India is Mumbai". The evaluator can detect: Incorrect answer, having Low relevance, Poor grounding.

• Batch jobs Batch jobs in Microsoft Foundry are used to process large numbers of AI requests together in bulk, instead of sending one request at a time. We can process many records/files/prompts in one go.

Conclusion - Microsoft Foundry is an end-to-end AI development platform used to create, manage, and deploy generative AI applications. Microsoft Foundry makes AI development easier by putting everything at one platform. Whether you’re just starting with AI or already working on AI projects, Foundry is really worth trying. It is easy to set up, simple to use, and helps you turn your ideas into real applications much faster.

                                                            Happy Exploring! Happy Learning!