Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Arrow stream writer and reader implementation questions #475

Open
schaefer01 opened this issue Jul 10, 2023 · 0 comments
Open

Arrow stream writer and reader implementation questions #475

schaefer01 opened this issue Jul 10, 2023 · 0 comments

Comments

@schaefer01
Copy link

I was using the python arrow function record_batch and find that this does not exist in julia, but there is an arrow table function. However they don’t behave the same way.

I have a customer requirement (that I can neither explain nor defend) of using arrow to
make a stream writer and reader of io bytes rather than just use julia bytes
This works using python arrows and batch_record
batch = pa.record_batch([data_in],names=[‘f0’])

My question is, is the problem syntax (typing it wrong) or semantics (just not possible to do because functionality was not ported)?

my julia code is as follows:
blksz = (32 * 1024)

A = rand(ComplexF16, blksz)

B = reinterpret(Float16, A)

C = reinterpret(UInt8, B)

tbl = Arrow.Table(C)

→ MethodError: no method matching open(::Base.ReinterpretArray{UInt8, 1, ComplexF16, Vector{ComplexF16}, false}, ::String

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant