Episode 502 - Azure Open AI and Security

by Sujit D'Mello August 15, 2024

Azure Open AI is widely used in industry but there are number of security aspects that must be taken into account when using the technology. Luckily for us, Audrey Long, a Software Engineer at Microsoft, security expert and renowned conference speaker, gives us insights into securing LLMs and provides various tips, tricks and tools to help developers use these models safely in their applications.

 

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode502.mp3

YouTube: https://youtu.be/64Achcz97PI

Resources:

AI Tooling:

  1. Azure AI Tooling Announcing new tools in Azure AI to help you build more secure and trustworthy generative AI applications | Microsoft Azure Blog
    • Prompt Shields to detect and block prompt injection attacks, including a new model for identifying indirect prompt attacks before they impact your model, coming soon and now available in preview in Azure AI Content Safety. 
    • Groundedness detection to detect “hallucinations” in model outputs, coming soon. 
    • Safety system messagesto steer your model’s behavior toward safe, responsible outputs, coming soon.
    • Safety evaluations to assess an application’s vulnerability to jailbreak attacks and to generating content risks, now available in preview.  
    • Risk and safety monitoring to understand what model inputs, outputs, and end users are triggering content filters to inform mitigations, coming soon, and now available in preview in Azure OpenAI Service.
  2. AI Defender for Cloud
  3.  AI Red Teaming Tool

AI Development Considerations:

 

  1. AI Assessment from Microsoft
  2. Microsoft Responsible AI Processes
  3. Define Use Case and Model Architecture
  4. Content Filtering System
  5. Red Teaming the LLM
  6. Create a Threat Model with OWASP Top 10

 

Other updates:

Keywords: ,

Filed Under: Podcast

Episode 485 - Copilot for Azure

by Sujit D'Mello February 9, 2024

Santosh Somayajula, a Principal Product Manager in Azure, breaks down the new Copilot for Azure service which is currently in Private Preview in the Azure Portal. Using this feature, administrators and management can perform operations in the Portal using simple verbal commands instead of navigating the UI.

 

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode485.mp3

YouTube: https://youtu.be/Gqv-qOOoK28

Resources: https://learn.microsoft.com/en-us/azure/copilot/overview

 https://aka.ms/MSCopilotforAzurePreviewRequest

 

Other updates:

General Availability: Azure Virtual Network encryption | Azure updates | Microsoft Azure

 

Public preview: ExpressRoute guided portal experience for multi-site resiliency | Azure updates | Microsoft Azure

 

General Availability: Azure MySQL Import feature for Azure Database for MySQL Single to Flexible Server migrations | Azure updates | Microsoft Azure 

 

Public Preview: Circuit Breaker in Azure API Management | Azure updates | Microsoft Azure  

 

https://azure.microsoft.com/en-us/updates/general-availability-azure-topology/

https://azure.microsoft.com/en-us/updates/mount-azure-storage-as-a-local-share-in-app-service-linux-now-supports-nfs/

https://azure.microsoft.com/en-us/updates/generally-available-continuous-model-monitoring-in-azure-machine-learning/

https://azure.microsoft.com/en-us/updates/public-preview-azure-api-center-features/

https://azure.microsoft.com/en-us/updates/public-preview-new-major-version-of-durable-functions-extension/

 

https://azure.microsoft.com/en-us/updates/generally-available-outbound-type-migration-in-aks/

 

Keywords: ,

Filed Under: Podcast

Episode 471 - AI Trends in Financial Services

by Sujit D'Mello August 30, 2023

We talk to Steve Selleny, a Global Partner Development Manager at Microsoft, about the AI and ML trends he has noticed in Financial Services ISVs. 

Steve has been working in the technology sector for over 21 years in various roles including software development, systems architecture, consulting, sales, and partner management. For the past two years, he has been working with Financial Services Independent Software Vendors (ISVs) to build and market solutions on the Microsoft Cloud that drive digital transformation for customers.

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode471.mp3

YouTube: https://youtu.be/6WDlqR34M48

Resources:

https://news.microsoft.com/2023/06/29/moodys-and-microsoft-develop-enhanced-risk-data-analytics-research-and-collaboration-solutions-powered-by-generative-ai/ 

 

Other updates:

Strengthening Your Defenses: Simulation Testing for Azure DDoS Protection - Microsoft Community Hub

https://azure.microsoft.com/updates/public-preview-ratelimit-rules-for-application-gateway-web

https://azure.microsoft.com/updates/general-availability-terraform-support-for-azure-cosmos-db

https://azure.microsoft.com/updates/generally-available-durable-functions-for-python-v2

https://azure.microsoft.com/updates/general-availability-99th-percentile-latency-metric-in-azure

Upgrade to App Service Environment v3 today and unlock new capabilities | Azure Blog | Microsoft Azure

https://azure.microsoft.com/en-us/updates/cloud-services-retirement-announcement/

 

Keywords: ,

Filed Under: Podcast

Episode 466 - Open AI

by Sujit D'Mello July 7, 2023

Cloud Solution Architect, Dr. Linda Sheard, joins Russell and Sujit for a primer on Azure Open AI. Linda breaks down the service and provides context on how it can be used for the typical scenario where a customer wants to reason over their own data. 

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode466.mp3

YouTube: https://youtu.be/nDcIWvHa43s

Resources: https://learn.microsoft.com/en-us/azure/cognitive-services/openai/overview

 

Other updates:

https://learn.microsoft.com/en-us/azure/container-registry/tutorial-registry-cache

Keywords:

Filed Under: Podcast

Episode 391 - AI/ML for Process Automation

by Sujit D'Mello August 27, 2021

The team speaks with Nikhil Vimal from Chat Mode about different use cases where combinations of Azure services can be used to infuse AI or leverage machine learning into automating processes.

Media File: https://azpodcast.blob.core.windows.net/episodes/Episode391.mp3

YouTube: https://www.youtube.com/watch?v=OYOmYhLbdyw

Resources:

https://www.microsoft.com/en-us/ai

Power Automate Desktop

Power Automate RPA

Power Automate UI Flow

Power Virtual Agents (AI Chatbots)

Microsoft Teams Bots

Azure Bot Services

 

Microsoft AI Research

Updates:

Genomics testing on the ISS with HPE Spaceborne Computer-2 and Azure

Keywords: , ,

Filed Under: Podcast

Episode 259 - AI and Hacks - Tales from the real world

by Russell Young December 21, 2018

Developer Evangelist David Gristwood and Cloud Solution Architect Robin Lester, from Microsoft UK, are enthusiastic about the AI hacks they do with partners to help them quickly realize an application that uses Azure's AI capabilities. They discuss common patterns and tips and tricks from their various hacks.

 

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode259.mp3

Transcript: https://www.videoindexer.ai/accounts/aca83d23-620b-46d6-beec-e920bff88847/videos/d4f658c21b/

Merry Christmas and Happy Holidays!

 

 

Keywords:

Filed Under: Podcast

Episode 235 - AI, Blockchain and Big Data discussion

by Cale Teeter June 29, 2018

Keywords: , ,

Filed Under: Podcast

Episode 224 - The AI Platform

by Sujit D'Mello April 13, 2018

Senior Product Marketing Manager Sonya Koptyev talks to us about the Azure AI Platform and give us some great pointers on how to get started with AI.

Media file: https://azpodcast.blob.core.windows.net/episodes/Episode224.mp3

 

Other updates:

Following last month's announcement of zone-redundant database support, Azure SQL Database is further expanding the power of databases and elastic pools by including read scale-out support in the Premium and Business Critical service tiers. 
This capability redirects the read-only client connections to one of the automatically provisioned HA replicas and effectively doubles the compute capacity of the database or elastic pool at no additional charge. This is ideal for load balancing of complex analytical workloads without affecting the primary OLTP workload.

https://azure.microsoft.com/en-us/updates/public-preview-of-read-scale-out-support/


Azure DevTest Labs is now available in Azure Government.
With this availability, US government agencies and their partners can modernize their legacy infrastructure to build fast, easy, and lean environments.

https://azure.microsoft.com/en-us/blog/azure-source-volume-26/


Offline media import for Azure
https://azure.microsoft.com/en-us/blog/offline-media-import-for-azure/

Achieving GDPR compliance in the cloud with Microsoft Azure
https://azure.microsoft.com/en-us/blog/achieving-gdpr-compliance-in-the-cloud-with-microsoft-azure/

Three common analytics use cases with Microsoft Azure Databricks
https://azure.microsoft.com/en-us/blog/three-critical-analytics-use-cases-with-microsoft-azure-databricks/

 

Keywords:

Filed Under: Podcast

Episode 195 - ML & AI

by Sujit D'Mello September 14, 2017

Evan and Sujit have a very insightful discussion about getting ramped up on Machine Learning and AI related workloads in Azure, with Azure RD, MVP and Architect - Vishwas Lele.

Media file: http://azpodcast.blob.core.windows.net/episodes/Episode195.mp3

Indexed audio: https://www.videoindexer.ai/media/519f272f27

https://channel9.msdn.com/Events/Microsoft-Azure/AzureCon-2015/ACON314

https://blog.appliedis.com/2017/01/18/pattern-matching-vs-deep-learning/

 

Other Updates:

Azure Active Directory Domain Services supports virtual networks created through the Resource Manager deployment model. This feature is in public preview.

https://azure.microsoft.com/en-us/updates/azure-ad-domain-services-support-for-resource-manager-virtual-networks-in-public-preview/

 


Announcing Default Encryption for Azure Blobs, Files, Table and Queue Storage
From <https://azure.microsoft.com/en-us/blog/announcing-default-encryption-for-azure-blobs-files-table-and-queue-storage/

 


Microsoft Azure expands with two new regions for Australia
Last month, we announced two new regions for Microsoft Azure located in Canberra, Australia and specifically designed to meet the needs of the Australian government. This increases the number of Azure regions announced across the globe to 42, more than any other major cloud provider.​ The two new regions, available in the first-half of 2018, are intended to be capable of handling sensitive Unclassified data as well as Protected data for the Australian government. Protected is a data classification for the first level of national security classified information in Australia. This is being achieved through a strategic partnership with the Australian-owned firm Canberra Data Centres (CDC). CDC are the preeminent specialist datacenter provider for secure government data in Australia with four modern Canberra-based facilities that hold the accreditations and security controls to handle even Top Secret classified data. ​

 

Accelerate Mission Critical database migrations
Migrating data to a modern Data Estate can be a painful, expensive and time-consuming effort. Fortunately, there is a new offering from Microsoft and Attunity to ease the pain. Attunity Replicate for Microsoft Migrations ingests data in the most popular commercial and open source databases to the Microsoft data platform. So, no matter where our customers data resides, they can now migrate it quickly, easily and securely to SQL Server on premises or in the Azure cloud.
Invite your customers to join experts from Microsoft and Attunity on a live webinar on September, 21st to learn how to:
 · Save time with an easy-to-use solution
 · Migrate data continuously with zero downtime
 · Lower the cost of data migration
 

Keywords: ,

Filed Under: Podcast

Announcements

Now on Spotify! Simply search for Azure Podcast and you will find it. Also available on YouTube and Amazon Music as well! 

Podcast Clients

You can find us on iTunes, Spotify, XBOX Music and in most Podcast clients on Android. Or simply use the RSS feed link above and plug it into your Podcast client.



Flyer

Love this podcast? Use this flyer to socialize it with your community.

Calendar

<<  November 2024  >>
MoTuWeThFrSaSu
28293031123
45678910
11121314151617
18192021222324
2526272829301
2345678

View posts in large calendar

Tag cloud