Python: Fix Python project metadata

[Viicos]

Remove duplicate dependencies
Make use of dependency-groups, dev-dependencies is deprecated
Fix uv lock file, many packages had mismatching wheel versions Add a miminum required uv version. 0.8.4 is the last one that changed the lockfile format. Requiring a miminum uv version avoids having the lockfile completely rewritten whenever a contributor makes changes with an old uv version.

cc @eavanvalkenburg @moonbox3, the broken lockfile is breaking third party tests in Pydantic. This is a weird issue, so I'm not sure what was done to get the lockfile in this broken state.

Motivation and Context

Description

Contribution Checklist

• The code builds clean without any errors or warnings
• The PR follows the SK Contribution Guidelines and the pre-submission formatting script raises no violations
• All unit tests pass, and I have added new tests where possible
• I didn't break anyone 😄

[eavanvalkenburg]

why was this removed?

[Viicos]

As per my PR description:

Remove duplicate dependencies

[eavanvalkenburg]

they're not actually duplicate, they were first put into the realtime extra, but then we did need them installed as standard, and removing the realtime extra would be a breaking change, so we didn't want to do that. Did now remove the specifiers so we don't get mismatches in them

[Viicos]

What I mean is that they are actually duplicates in the dependencies table:

semantic-kernel/python/pyproject.toml

Lines 25 to 55 in 2534964

	dependencies = [
	# azure agents
	"azure-ai-projects >= 1.0.0b12",
	"azure-ai-agents >= 1.2.0b3",
	"aiohttp ~= 3.8",
	"cloudevents ~=1.0",
	"pydantic >=2.0,!=2.10.0,!=2.10.1,!=2.10.2,!=2.10.3,<2.12",
	"pydantic-settings ~= 2.0",
	"defusedxml ~= 0.7",
	# azure identity
	"azure-identity >= 1.13",
	# embeddings
	"numpy >= 1.25.0; python_version < '3.12'",
	"numpy >= 1.26.0; python_version >= '3.12'",
	# openai connector
	"openai >= 1.98.0,<2",
	# openapi and swagger
	"openapi_core >= 0.18,<0.20",
	"websockets >= 13, < 16",
	"aiortc>=1.9.0",
	# OpenTelemetry
	"opentelemetry-api ~= 1.24",
	"opentelemetry-sdk ~= 1.24",
	"prance >= 23.6.21,< 25.4.9",
	# templating
	"pybars4 ~= 0.9",
	"jinja2 ~= 3.1",
	"nest-asyncio ~= 1.6",
	"scipy>=1.15.1",
	"websockets >= 13, < 16",
	"aiortc>=1.9.0",

[eavanvalkenburg]

@Viicos thanks for having a look, I created a new PR with the same changes and also updates to the github actions to get everything running again, so I'm going to close this one.