Improve Salesforce connector

[hagen-danswer]

Description

• we now finish retrieving all information for 200 docs and then yield those out in batches rather than doing every single one and then yielding
• updated section generation logic to support sectional permission censoring
• general code cleanup

How Has This Been Tested?

• wrote one basic test
• tested by hand

Backporting (check the box to trigger backport action)

Note: You have to check that the action passes, otherwise resolve the conflicts manually and tag the patches.

• This PR should be backported (make sure to check that the backport attempt succeeds)

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Comments	Updated (UTC)
internal-search	✅ Ready (Inspect)	Visit Preview	💬 Add feedback	Dec 29, 2024 9:25pm