Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Faster (batch) insert #1

Open
Vanuan opened this issue Apr 21, 2016 · 7 comments
Open

Faster (batch) insert #1

Vanuan opened this issue Apr 21, 2016 · 7 comments

Comments

@Vanuan
Copy link
Member

Vanuan commented Apr 21, 2016

Investigate why does it take so long to insert data.

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

Use redis for socket session: 7f37f81
Prevent crashes: 9218f50
Use redis for http session: 64bf818

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

Additionally, add these lines to /etc/rc.local

echo never > /sys/kernel/mm/transparent_hugepage/enabled
echo never > /sys/kernel/mm/transparent_hugepage/defrag

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
**        We suggest setting it to 'never'
** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
**        We suggest setting it to 'never'

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

edr_1           | FATAL ERROR: CALL_AND_RETRY_LAST Allocation failed - process out of memory
edr_1           | Aborted (core dumped)
edr_edr_1 exited with code 134

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

  File "<string>", line 3, in <module>
  File "compose/cli/main.py", line 57, in main
  File "compose/cli/main.py", line 108, in perform_command
  File "compose/cli/main.py", line 741, in up
  File "compose/cli/log_printer.py", line 86, in run
  File "compose/cli/log_printer.py", line 222, in consume_queue
MemoryError
docker-compose returned -1

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

@Vanuan
Copy link
Member Author

Vanuan commented Apr 24, 2016

# WARNING overcommit_memory is set to 0!
Background save may fail under low memory condition.
To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf
and then reboot or run the command 'sysctl vm.overcommit_memory=1'
for this to take effect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant