Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upstream merge 25 01 20 #368

Merged
merged 92 commits into from
Jan 20, 2025
Merged

Upstream merge 25 01 20 #368

merged 92 commits into from
Jan 20, 2025

Conversation

gshtras
Copy link
Collaborator

@gshtras gshtras commented Jan 20, 2025

No description provided.

Yikun and others added 30 commits January 13, 2025 17:23
@Yikun
[Doc] Fix build from source and installation link in README.md (vllm-…
289b519 
…project#12013)

Signed-off-by: Yikun <[email protected]>
@SunflowerAries @mgoin
[Bugfix] Fix deepseekv3 gate bias error (vllm-project#12002)
f35ec46 
Signed-off-by: mgoin <[email protected]>
Co-authored-by: mgoin <[email protected]>
@WoosukKwon
[Docs] Add Sky Computing Lab to project intro (vllm-project#12019)
1a40125 
Signed-off-by: Woosuk Kwon <[email protected]>
@kzawora-intel
[HPU][Bugfix] set_forward_context and CI test execution (vllm-project…
078da31 
…#12014)

Signed-off-by: Konrad Zawora <[email protected]>
@tjtanaa
[Doc] Update Quantization Hardware Support Documentation (vllm-projec…
8a1f938 
…t#12025)

Signed-off-by: tjtanaa <[email protected]>
Co-authored-by: tjtanaa <[email protected]>
@youkaichao
[HPU][misc] add comments for explanation (vllm-project#12034)
ff39141 
Signed-off-by: youkaichao <[email protected]>
@DarkLight1337
[Bugfix] Fix various bugs in multi-modal processor (vllm-project#12031)
bb354e6 
Signed-off-by: DarkLight1337 <[email protected]>
@heheda12345
[Kernel] Revert the API change of Attention.forward (vllm-project#12038)
1f18adb 
Signed-off-by: Chen Zhang <[email protected]>
@wangxiyuan
[Platform] Add output for Attention Backend (vllm-project#11981)
2e0e017 
Signed-off-by: wangxiyuan <[email protected]>
@heheda12345
[Bugfix][Kernel] Give unique name to BlockSparseFlashAttention (vllm-…
a2d2acb 
…project#12040)

Signed-off-by: Chen Zhang <[email protected]>
@hmellor
Explain where the engine args go when using Docker (vllm-project#12041)
c9d6ff5 
Signed-off-by: Harry Mellor <[email protected]>
@maang-h
[Doc]: Update the Json Example of the Engine Arguments document (vl…
87054a5 
…lm-project#12045)
@jeejeelee
[Misc] Merge bitsandbytes_stacked_params_mapping and packed_modules_m…
a3a3ee4 
…apping (vllm-project#11924)

Signed-off-by: Jee Jee Li <[email protected]>
@jeejeelee
[Kernel] Support MulAndSilu (vllm-project#11624)
42f5e7c 
Signed-off-by: Jee Jee Li <[email protected]>
@kzawora-intel
[HPU][Bugfix] Don't use /dev/accel/accel0 for HPU autodetection in se…
1a51b9f 
…tup.py (vllm-project#12046)

Signed-off-by: Konrad Zawora <[email protected]>
@shen-shanshan
[Platform] move current_memory_usage() into platform (vllm-project#11369
9ddac56 
)

Signed-off-by: Shanshan Shen <[email protected]>
@WoosukKwon
[V1][BugFix] Fix edge case in VLM scheduling (vllm-project#12065)
b7ee940 
Signed-off-by: Woosuk Kwon <[email protected]>
@elfiegg
[Misc] Add multipstep chunked-prefill support for FlashInfer (vllm-pr…
0794e74 
…oject#10467)
@ruisearch42
[core] Turn off GPU communication overlap for Ray executor (vllm-proj…
f218f9c 
…ect#12051)

Signed-off-by: Rui Qiao <[email protected]>
@youkaichao
[core] platform agnostic executor via collective_rpc (vllm-project#11256
ad34c0d 
)

Signed-off-by: youkaichao <[email protected]>
@kylesayrs
[Doc] Update examples to remove SparseAutoModelForCausalLM (vllm-proj…
3f9b7ab 
…ect#12062)

Signed-off-by: Kyle Sayers <[email protected]>
@heheda12345
[V1][Prefix Cache] Move the logic of num_computed_tokens into KVCache…
994fc65 
…Manager (vllm-project#12003)
@rahul-tuli
Fix: cases with empty sparsity config (vllm-project#12057)
cbe9439 
Signed-off-by: Rahul Tuli <[email protected]>
@youngkent
Type-fix: make execute_model output type optional (vllm-project#12020)
ad388d2
@wangxiyuan @MengqingCao
[Platform] Do not raise error if _Backend is not found (vllm-project#…
3adf0ff 
…12023)

Signed-off-by: wangxiyuan <[email protected]>
Signed-off-by: Mengqing Cao <[email protected]>
Co-authored-by: Mengqing Cao <[email protected]>
@RunningLeon
[Model]: Support internlm3 (vllm-project#12037)
97eb97b
@zhouyuan
Misc: allow to use proxy in HTTPConnection (vllm-project#12042)
5ecf3e0 
Signed-off-by: Yuan Zhou <[email protected]>
@kewang-xlnx @mgoin
[Misc][Quark] Upstream Quark format to VLLM (vllm-project#10765)
de0526f 
Signed-off-by: kewang-xlnx <[email protected]>
Signed-off-by: kewang2 <[email protected]>
Co-authored-by: kewang2 <[email protected]>
Co-authored-by: Michael Goin <[email protected]>
@maang-h
[Doc]: Update OpenAI-Compatible Server documents (vllm-project#12082)
57e729e
@joerunde
[Bugfix] use right truncation for non-generative tasks (vllm-project#…
edce722 
…12050)

Signed-off-by: Joe Runde <[email protected]>
simon-mo and others added 27 commits January 19, 2025 03:07
@simon-mo
[V1] Collect env var for usage stats (vllm-project#12115)
7a8a48d
@madamczykhabana
[BUGFIX] Move scores to float32 in case of running xgrammar on cpu (v…
4e94951 
…llm-project#12152)

Signed-off-by: Michal Adamczyk <[email protected]>
@DarkLight1337
[Bugfix] Fix multi-modal processors for transformers 4.48 (vllm-proje…
630eb5b 
…ct#12187)
@youkaichao
[torch.compile] store inductor compiled Python file (vllm-project#12182)
e66faf4 
Signed-off-by: youkaichao <[email protected]>
@gujingit @ywang96
benchmark_serving support --served-model-name param (vllm-project#12109)
936db11 
Signed-off-by: zibai <[email protected]>
Co-authored-by: Roger Wang <[email protected]>
@Isotr0py
[Misc] Add BNB support to GLM4-V model (vllm-project#12184)
edaae19 
Signed-off-by: Isotr0py <[email protected]>
@ywang96 @imkero @DarkLight1337
[V1] Add V1 support of Qwen2-VL (vllm-project#12128)
81763c5 
Signed-off-by: Roger Wang <[email protected]>
Signed-off-by: DarkLight1337 <[email protected]>
Co-authored-by: imkero <[email protected]>
Co-authored-by: DarkLight1337 <[email protected]>
@MartinGleize
[Model] Support for fairseq2 Llama (vllm-project#11442)
bbe5f9d 
Signed-off-by: Martin Gleize <[email protected]>
Co-authored-by: mgleize user <[email protected]>
@ShangmingCai
[Bugfix] Fix num_heads value for simple connector when tp enabled (vl…
df450aa 
…lm-project#12074)

Signed-off-by: Shangming Cai <[email protected]>
@youkaichao
[torch.compile] fix sym_tensor_indices (vllm-project#12191)
51ef828 
Signed-off-by: youkaichao <[email protected]>
@hmellor
Move linting to pre-commit (vllm-project#11975)
3ea7b94 
Signed-off-by: Harry Mellor <[email protected]>
@terrytangyuan
[DOC] Fix typo in docstring and assert message (vllm-project#12194)
c5c0620 
Signed-off-by: Yuan Tang <[email protected]>
@terrytangyuan
[DOC] Add missing docstring in LLMEngine.add_request() (vllm-project#…
d264312 
…12195)

Signed-off-by: Yuan Tang <[email protected]>
@terrytangyuan
[Bugfix] Fix incorrect types in LayerwiseProfileResults (vllm-project…
0974c9b 
…#12196)

Signed-off-by: Yuan Tang <[email protected]>
@Isotr0py
[Model] Add Qwen2 PRM model support (vllm-project#12202)
8360979 
Signed-off-by: Isotr0py <[email protected]>
@DarkLight1337
[Core] Interface for accessing model from VllmRunner (vllm-project#…
59a0192 
…10353)

Signed-off-by: DarkLight1337 <[email protected]>
@youkaichao
[misc] add placeholder format.sh (vllm-project#12206)
5c89a29 
Signed-off-by: youkaichao <[email protected]>
@DarkLight1337
[CI/Build] Remove dummy CI steps (vllm-project#12208)
4001ea1 
Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[CI/Build] Make pre-commit faster (vllm-project#12212)
3127e97 
Signed-off-by: DarkLight1337 <[email protected]>
@DarkLight1337
[Model] Upgrade Aria to transformers 4.48 (vllm-project#12203)
b37d827 
Signed-off-by: DarkLight1337 <[email protected]>
@youkaichao
[misc] print a message to suggest how to bypass commit hooks (vllm-pr…
170eb35 
…oject#12217)

Signed-off-by: youkaichao <[email protected]>
@youkaichao
[core][bugfix] configure env var during import vllm (vllm-project#12209)
c222f47 
Signed-off-by: youkaichao <[email protected]>
@heheda12345
[V1] Remove _get_cache_block_size (vllm-project#12214)
5f0ec39 
Signed-off-by: Chen Zhang <[email protected]>
@wangxiyuan
[Misc] Pass attention to impl backend (vllm-project#12218)
86bfb6d 
Signed-off-by: wangxiyuan <[email protected]>
@DarkLight1337
[Bugfix] Fix HfExampleModels.find_hf_info (vllm-project#12223)
18572e3 
Signed-off-by: DarkLight1337 <[email protected]>
@heheda12345
[CI] Pass local python version explicitly to pre-commit mypy.sh (vllm…
9666369 
…-project#12224)

Signed-off-by: Chen Zhang <[email protected]>
@gshtras
Merge remote-tracking branch 'upstream/main'
031e6eb
@gshtras gshtras merged commit 3e1cadb into main Jan 20, 2025
2 of 3 checks passed
@gshtras gshtras deleted the upstream_merge_25_01_20 branch January 20, 2025 21:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@shajrawi shajrawi shajrawi approved these changes

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.