Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Where does the single JSON object get stored in memory? #21

Closed
XYTYX opened this issue May 25, 2016 · 2 comments
Closed

Where does the single JSON object get stored in memory? #21

XYTYX opened this issue May 25, 2016 · 2 comments
Labels

Comments

@XYTYX
Copy link

XYTYX commented May 25, 2016

Hi Lukas,
According to your docs...

Instead of using JSON lines you can also import a single JSON object into the database. This will load the JSON document into memory first.
I'm unsure of what this means, I've executed the command with no errors, but where in memory is my uploaded(?) JSON object?

Thanks in advance.

@XYTYX XYTYX changed the title Where Where does the single JSON object get stored in memory? May 25, 2016
@lukasmartinelli
Copy link
Owner

This will load the JSON document into memory first.

What I meant by this is that if you have a very large JSON object (2GB) this will also require 2GB memory to load the object into the buffer. But this has nothing to do with the database.

I recommend to use json lines importing a single JSON object was a use case in this issue #9

But if you use the normal json lines an have n records you don't need O(n) space as each record is loaded into memory and decoded as you go.

@lukasmartinelli
Copy link
Owner

Single JSON mode is deprecated due to lack of use and instability #47

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants