Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update of start-up script to download tes_vm_perf.tgz and execute bootstrapper #622

Draft
wants to merge 48 commits into
base: main
Choose a base branch
from
Draft
Changes from 1 commit
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
a2e5c16
Update of start-up script to download tes_vm_perf.tgz and execute boo…
jlester-msft Feb 27, 2024
1a3da64
Side-step build tests
jlester-msft Feb 28, 2024
c663328
Add dummy function for the correct call
jlester-msft Feb 28, 2024
1712d1c
add catch for GetInternalTesBlobUrlAsync
jlester-msft Feb 28, 2024
3618aea
chmod typo fixed
jlester-msft Feb 28, 2024
70eff6a
Add script to be uploaded every time
MattMcL4475 Feb 28, 2024
2d20d3d
remove try/catch
MattMcL4475 Feb 28, 2024
bd0c9eb
extract explictly to AZ_BATCH_TASK_DIR
jlester-msft Feb 28, 2024
fa98c05
disable extraction and running integration test
jlester-msft Feb 29, 2024
ffdae36
Add absolute paths for tar
jlester-msft Feb 29, 2024
baaf634
Wrap batch_script execution in a function, call it with screen, and u…
jlester-msft Feb 29, 2024
3964c62
Updating bash script
jlester-msft Feb 29, 2024
901e207
Update scripts and use python to parse nodetaskurl
jlester-msft Feb 29, 2024
d1a294c
Update python script, msi auth for azcopy, add task complete, and add…
jlester-msft Feb 29, 2024
e5c9cb2
missing semicolon
jlester-msft Feb 29, 2024
bc0e7db
remove windows line endings
jlester-msft Feb 29, 2024
c4733d3
batchNodeScript is ending up with Windows Style line endings which is…
jlester-msft Feb 29, 2024
432c8d4
export env and load it inside screen. Also run outside screen once
jlester-msft Feb 29, 2024
5316a4b
fix missing quote
jlester-msft Mar 1, 2024
6750b7d
convert script to @strings
jlester-msft Mar 1, 2024
e3e0689
Add shebang disable direct script call
jlester-msft Mar 1, 2024
459b90f
Cleanup of bash_script construction, build pipeline test
jlester-msft Mar 4, 2024
0331bdd
remove unused functions
jlester-msft Mar 4, 2024
9049421
Add additional debugging capture of host system on failure, change st…
jlester-msft Mar 5, 2024
4c224a7
Add debugging tools
jlester-msft Mar 5, 2024
510268c
Always collect debug info
jlester-msft Mar 5, 2024
72a81fd
Update naming of perf archive to tes_vm_monitor.tar.gz
jlester-msft Mar 22, 2024
38a986f
Merge branch 'main' into jlester/vm_node_perf
jlester-msft Mar 22, 2024
0dec8bc
remove old tes_vm_perf.tar.gz
jlester-msft Mar 25, 2024
c68386f
update path in csproj
jlester-msft Mar 25, 2024
270dd63
Merge branch 'jlester/vm_node_perf' of https://github.com/microsoft/g…
jlester-msft Mar 25, 2024
a5f840d
Update telegraf dockerfile to pull latest golang and latest telegraf …
jlester-msft Mar 25, 2024
656162d
Update bash scripting, remove jq requirement, add nvme mounting (#648)
BMurri Mar 25, 2024
c6c2394
Merge branch 'main' into jlester/vm_node_perf
BMurri Mar 25, 2024
1e33b7c
formatting
BMurri Mar 25, 2024
28e20cc
remove unused binary
BMurri Mar 26, 2024
80b6ca9
surface vm_monitor in VisualStudio IDE
BMurri Mar 26, 2024
a0acec0
Add configuration (disabled by default) to gate this feature
BMurri Mar 26, 2024
d73742e
move monitor download to start task
BMurri Mar 26, 2024
b4afa2b
make download conditional
BMurri Mar 26, 2024
b43abc6
cleanup python code in pool creation + add pulling of config from an …
jlester-msft Mar 27, 2024
01d5373
Updating help comment
jlester-msft Mar 27, 2024
eed6263
Correct tags in vm_monitor collection
jlester-msft Apr 5, 2024
54a1110
Add mtime filtering to filestat input plugin. Prefer input.filestat o…
jlester-msft Apr 8, 2024
3a56cf9
Update dockerfile to patch in builder. Also update filtering logic to…
jlester-msft Apr 8, 2024
59f3a31
Add url validation to azure_append_blob
jlester-msft Apr 15, 2024
56379d9
Merge branch 'main' into jlester/vm_node_perf with runtime integratio…
BMurri Sep 26, 2024
d4ec1c9
minor cleanup
BMurri Sep 27, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
add catch for GetInternalTesBlobUrlAsync
jlester-msft committed Feb 28, 2024
commit 1712d1c9a284438689b3e2347f1b5b55b6d00fa2
10 changes: 9 additions & 1 deletion src/TesApi.Web/Runner/TaskExecutionScriptingManager.cs
Original file line number Diff line number Diff line change
@@ -127,7 +127,15 @@
logger.LogInformation($"Creating and uploading Batch script for Task ID: {tesTask.Id}");

var nodeTaskRunnerUrl = await storageAccessProvider.GetInternalTesBlobUrlAsync(NodeTaskRunnerFilename, cancellationToken);
var nodeVMPerfArchiveUrl = await storageAccessProvider.GetInternalTesBlobUrlAsync(VMPerformanceArchiverFilename, cancellationToken);
Uri nodeVMPerfArchiveUrl;
try
{
nodeVMPerfArchiveUrl = await storageAccessProvider.GetInternalTesBlobUrlAsync(VMPerformanceArchiverFilename, cancellationToken);
}
catch (Exception e)

Check warning on line 135 in src/TesApi.Web/Runner/TaskExecutionScriptingManager.cs

GitHub Actions / build

The variable 'e' is declared but never used

Check warning on line 135 in src/TesApi.Web/Runner/TaskExecutionScriptingManager.cs

GitHub Actions / build

The variable 'e' is declared but never used

Check warning on line 135 in src/TesApi.Web/Runner/TaskExecutionScriptingManager.cs

GitHub Actions / build

The variable 'e' is declared but never used

Check warning on line 135 in src/TesApi.Web/Runner/TaskExecutionScriptingManager.cs

GitHub Actions / build

The variable 'e' is declared but never used
{
nodeVMPerfArchiveUrl = null;
}

var batchNodeScript = batchNodeScriptBuilder
.WithAlpineWgetInstallation()

Unchanged files with check annotations Beta

/// <param name="runnerTaskInfoUrl"></param>
/// <param name="vmPerfArchiveUrl"></param>
/// <returns></returns>
public BatchNodeScriptBuilder WithRunnerFilesDownloadUsingWget(Uri runnerBinaryUrl, Uri runnerTaskInfoUrl, Uri? vmPerfArchiveUrl)

Check warning on line 87 in src/TesApi.Web/BatchNodeScriptBuilder.cs

GitHub Actions / build

The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.

Check warning on line 87 in src/TesApi.Web/BatchNodeScriptBuilder.cs

GitHub Actions / build

The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.

Check warning on line 87 in src/TesApi.Web/BatchNodeScriptBuilder.cs

GitHub Actions / build

The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.

Check warning on line 87 in src/TesApi.Web/BatchNodeScriptBuilder.cs

GitHub Actions / build

The annotation for nullable reference types should only be used in code within a '#nullable' annotations context.
{
ArgumentNullException.ThrowIfNull(runnerBinaryUrl);
ArgumentNullException.ThrowIfNull(runnerTaskInfoUrl);