Skip to content
This repository was archived by the owner on Dec 4, 2024. It is now read-only.

MWT-27 #581

Open
wants to merge 67 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
ef3c10d
Add visual separations for the script's sections.
mpereira Sep 11, 2019
70579ca
Make container name be dependent on test parameter file name.
mpereira Sep 11, 2019
9564118
Check package repos every time, create Marathon group.
mpereira Sep 11, 2019
287a9b9
Use container name for docker image tag and run directory.
mpereira Sep 12, 2019
04717bd
Automatically format some files with Black.
mpereira Oct 7, 2019
9fbca5b
Parameterize group file name, run commands in container.
mpereira Oct 7, 2019
0e856a2
Run commands in the container.
mpereira Oct 7, 2019
d9a7e96
Quote this.
mpereira Oct 7, 2019
585beac
Make deploy-dispatchers.py script support group roles.
mpereira Oct 7, 2019
c4d870f
Show CLUSTER_URL in pre-run report.
mpereira Oct 7, 2019
cd95b27
Add group_role support to streaming workload deploy script.
mpereira Oct 7, 2019
5c1c912
Make sure service name is prefixed with a slash.
mpereira Oct 7, 2019
f40351a
Add group_role support to the batch_test.py script.
mpereira Oct 7, 2019
0b25ba5
Add required roles and permissions required for group role enforcement.
mpereira Oct 7, 2019
0a2f2d1
Add spark-options.json file.
mpereira Oct 7, 2019
2bd9407
Typo.
mpereira Oct 8, 2019
73b5824
Add CLI parameter description.
mpereira Oct 9, 2019
bf0fcf0
Remove failing jobs stuff.
mpereira Oct 9, 2019
0025ef4
Fix shellcheck warning.
mpereira Oct 9, 2019
50b56ef
Variable renames, shellcheck fixes, DSEngine, total cpu/mem/gpu.
mpereira Oct 9, 2019
b849f5d
GROUP_NAME should be coming with no slash prefix.
mpereira Oct 9, 2019
2f1075b
Create quota if it doesn't exit.
mpereira Oct 9, 2019
222cbe2
Install recent DC/OS CLI.
mpereira Oct 10, 2019
464a17b
Fix quoting.
mpereira Oct 10, 2019
af9129e
Should be group name here.
mpereira Oct 10, 2019
c2daf5e
Make revoke_permissions() also take role list.
mpereira Oct 10, 2019
65b3fd9
Fix indentation.
mpereira Oct 10, 2019
bec6c9f
Make DC/OS CLI binary a parameter.
mpereira Oct 10, 2019
5b34f05
Don't break out of loop, just skip to the next element.
mpereira Oct 10, 2019
3cd62ec
This was breaking.
mpereira Oct 10, 2019
b9fa2ec
Add script to list service tasks.
mpereira Oct 10, 2019
1931abb
service_options was being used before being set.
mpereira Oct 10, 2019
956200c
Fix environment variable name.
mpereira Oct 10, 2019
976a775
installing jupiter
alexeygorobets Oct 10, 2019
5d25c89
Improve DSEngine workload deployment script and options.
mpereira Oct 10, 2019
78904b7
rename dsengine options to dsengine-options.jso
alexeygorobets Oct 11, 2019
275da0f
rename dsengine options to dsengine-options.json
alexeygorobets Oct 11, 2019
c52f1ed
add MWT-25 dry run and MWT-25 configs
alexeygorobets Sep 14, 2020
ae341c2
update cluster url for MWT26
alexeygorobets Sep 14, 2020
b474d78
update kafka version to 2.10.0-5.5.1-beta
alexeygorobets Sep 14, 2020
6cd6997
enable exernal volumes on kafka brokers
alexeygorobets Sep 14, 2020
030a3cf
update confluent-zk version to 2.8.0-5.5.1-beta
alexeygorobets Sep 14, 2020
ba74e60
update Cassandra to 2.10.0-3.11.6-beta
alexeygorobets Sep 14, 2020
05743fa
add external volumes to cassandra options
alexeygorobets Sep 14, 2020
610e6a3
use latest spark 2.11.0-2.4.6
rishabh96b Sep 29, 2020
6888ecc
update spark stub to universe-converter
rishabh96b Sep 29, 2020
3a4b36e
Merge branch 'dcos-58437-deploy-workloads-under-role-enforced-group' …
alexeygorobets Sep 29, 2020
6ffb082
Adds data science engine configs
farhan5900 Sep 29, 2020
288b97a
update configs for dry run
alexeygorobets Sep 29, 2020
853dbe5
use root user for services
alexeygorobets Sep 29, 2020
f087a33
Merge remote-tracking branch 'origin/mwt-26' into mwt-26
alexeygorobets Sep 29, 2020
c8e8fdc
Grant task:user:root permissions on master and agent for DSE.
kaiwalyajoshi Sep 29, 2020
7d85cbb
install DSE with other services
alexeygorobets Sep 30, 2020
8b71331
update dsengine options
alexeygorobets Sep 30, 2020
a8c6e56
Merge branch 'mwt-26' of https://github.com/mesosphere/spark-build in…
alexeygorobets Sep 30, 2020
083ebb9
fix DSE permissions
alexeygorobets Oct 1, 2020
2750a25
add MWT 26 config
alexeygorobets Oct 1, 2020
6032efa
not using GPU in DSE
alexeygorobets Oct 1, 2020
aaace06
fix marathon check for batched job
alexeygorobets Oct 1, 2020
d34af99
use right branch in batched workload for spark
alexeygorobets Oct 1, 2020
20d3f85
add configs for mwt-27
rishabh96b Oct 20, 2020
b8f487c
update cluster url
alexeygorobets Oct 20, 2020
98acfd1
enable gpu for dsengine
alexeygorobets Oct 20, 2020
9e28aa8
use zk-beta package
alexeygorobets Oct 20, 2020
540d600
run DSE as root
alexeygorobets Oct 20, 2020
2ea2c1e
add dcos:mesos:master:task:app_id permission for dse
alexeygorobets Oct 20, 2020
675f2e1
update config for mwt-27 run
alexeygorobets Oct 23, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Grant task:user:root permissions on master and agent for DSE.
kaiwalyajoshi committed Sep 29, 2020
commit c8e8fdcbd107c63510872a44a6bd7bfc0cdabc46
6 changes: 6 additions & 0 deletions scale-tests/deploy_dsengine.sh
Original file line number Diff line number Diff line change
@@ -32,6 +32,12 @@ grant_permissions() {
dcos security org users grant "${SERVICE_ACCOUNT}" \
"dcos:mesos:agent:task:user:nobody" \
create
dcos security org users grant "${SERVICE_ACCOUNT}" \
"dcos:mesos:master:task:user:root" \
create
dcos security org users grant "${SERVICE_ACCOUNT}" \
"dcos:mesos:agent:task:user:root" \
create
dcos security org users grant "${SERVICE_ACCOUNT}" \
"dcos:secrets:list:default:__dcos_base64__hdfs_jupyter_keytab" \
read