[Session,Supplier] Implement deterministic session suppliers

[red-0ne]

Summary

Replace supplier's activation heights map with a service config history for better tracking of service changes over time.

Primary Changes:

• Replace ServicesActivationHeightsMap with ServiceConfigHistory to track service configurations and their activation heights
• Add ServiceConfigUpdate message type to store service configurations and their effective block heights
• Introduce BeginBlockerActivateSupplierServices to handle service activations at session start blocks

Secondary changes:

• Update tests to handle service activation at session boundaries
• Add helper functions for managing service configuration updates
• Clean up supplier test suite organization

Issue

• Description:
• Issue: [Session] Ensure deterministic supplier set for historical sessions #1089

Type of change

Select one or more from the following:

• New feature, functionality or library
• Consensus breaking; add the consensus-breaking label if so. See [Infra] Automatically add the consensus-breaking label #791 for details
• Bug fix
• Code health or cleanup
• Documentation
• Other (specify)

Sanity Checklist

• I have updated the GitHub Issue assignees, reviewers, labels, project, iteration and milestone
• For docs, I have run make docusaurus_start
• For code, I have run make go_develop_and_test and make test_e2e
• For code, I have added the devnet-test-e2e label to run E2E tests in CI
• For configurations, I have update the documentation
• I added TODOs where applicable

[Olshansk]

@red-0ne

1. No major blockers, just a handful of comments here and there.

2. This is REALLY great work! I can tell this wasn't easy to implement ;). Great job on just handling everything from start to finish.

3. Do you think this warrants one E2E test (for regression purposes)?

4. Wanted to align on WHY this is not needed for applications. Apps can come in mid-session and just get a new set of suppliers, and begin paying for services right away. Aligned?

[github-actions]

The CI will now also run the e2e tests on devnet, which increases the time it takes to complete all CI checks.

You may need to run make trigger_ci to submit an empty commit that'll trigger the tests.

GCP workloads (requires changing the namespace to 1103)
Grafana network dashboard for devnet-issue-1103

[red-0ne]

Wanted to align on WHY this is not needed for applications. Apps can come in mid-session and just get a new set of suppliers, and begin paying for services right away. Aligned?

Yes, apps can join mid-session and start using a service.

This is because applications are part of the session existence, before an app joins, the session simply doesn't exist. Which is not the case for suppliers.

[Olshansk]

Suggested change

	// TODO_POST_MAINNET: Use the number of suppliers per session used as of the query height.
	// As of now the session is hydrated with the "current" NumSuppliersPerSession param value.
	// We need to account for NumSuppliersPerSession as of the query height to ensure
	// that the session is hydrated with the old number of suppliers in case the param
	// has changed between the query height and the current height.
	numSuppliersPerSession := int(k.GetParams(ctx).NumSuppliersPerSession)
	// Get all suppliers instead of filtering by service ID.
	// Suppliers may not be active for the session's service ID at "query height",
	// so we cannot filter by supplier.Services which represents the services
	// the supplier is active for at the "current height".
	suppliers := k.supplierKeeper.GetAllSuppliers(ctx)
	// A mapping from the supplier operator address to a random weight.
	// This is used for sorting the suppliers.
	// If NumCandidateSuppliers > NumSuppliersPerSession, the deterministic sorting order
	// is used to determine which ones are available to serve requests to enable fair but
	// random opportunity to serve Applications (i.e. do useful work).
	candidatesToRandomWeight := make(map[string]int)
	// TODO_POST_MAINNET: Use the number of suppliers per session used at query height (i.e. sh.blockHeight).
	// Currently, the session is hydrated with the "current" (i.e. latest block) NumSuppliersPerSession param value.
	// We need to account for the value at query height to ensure:
	// - The session is hydrated with the correct historical number of suppliers
	// - Changes between query height and current height are properly handled
	numSuppliersPerSession := int(k.GetParams(ctx).NumSuppliersPerSession)
	// Get all suppliers without service ID filtering because:
	// - Suppliers may not be active for the session's service ID at "query height"
	// - We cannot filter by supplier.Services which only represents current (i.e. latest) height
	suppliers := k.supplierKeeper.GetAllSuppliers(ctx)
	// Map supplier operator addresses to random weights for deterministic sorting.
	// This ensures fair distribution when:
	// - NumCandidateSuppliers exceeds NumSuppliersPerSession
	// - We need to randomly but fairly determine which suppliers can serve Applications
	candidatesToRandomWeight := make(map[string]int)

[Olshansk]

@red-0ne I cleaned up the comments while reading+thinking through it.

Are you sure this is a POST_MAINNET action item?

I realize this is potentially an edge case, but I'm a bit afraid this can have very important ramifications to the C&P lifecycle, session ID generation, etc...

[Olshansk]

I don't want to slow down or block this PR.

Let's change this to a TODO_MAINNET so we don't forget to revisit it next week while thinking/talking about it in parallel.

[Olshansk]

We should be good to get this over the finish line soon. Just a few more questions/comments.

Thank you so much for the high quality PR!

[Olshansk]

Can you move this into a small local helper that returns int(binary.BigEndian.Uint64(candidateSeedHash[:8]))?

[Olshansk]

I don't want to slow down or block this PR.

Let's change this to a TODO_MAINNET so we don't forget to revisit it next week while thinking/talking about it in parallel.

[Olshansk]

Haha, this is fun

[Olshansk]

Suggested change

	slices.SortFunc(candidateSuppliers, weightedSupplierSortFn)
	slices.SortFunc(candidateSuppliers, weightedSupplierSortFn)

[Olshansk]

Suggested change

	// at the current block height. It returns the number of suppliers whose services were activated.
	// at the current block height.
	// It returns the number of suppliers whose services were activated.

[Olshansk]

Suggested change

	// TODO_BETA(@red-0ne): Update supplier staking documentation to remove the upstaking requirement and introduce the staking fee.
	// TODO_POST_MAINNET(@red-0ne): Update supplier staking documentation to remove the upstaking requirement and introduce the staking fee.

[Olshansk]

Great comment

[Olshansk]

This was your comment in the PR:

This is because applications are part of the session existence, before an app joins, the session simply doesn't exist. Which is not the case for suppliers.

I think this is really great.

Can you think of a good place to stuff this in the code somewhere so it's not lost?

[Olshansk]

Suggested change

[Olshansk]

Can you say more please? #PUC