36,500 questions
0
votes
0
answers
19
views
Unable to find required GLIBC private symbols
I am trying to analyze a memory dump obtained with dotnet-dump from a Ubuntu container in WinDbg to find an unmanaged memory leak.
I have been able to load the dump, but whenever I try to run !heap -s,...
- 9,635
1
vote
0
answers
36
views
Why do I observe so high memory usage for copying a Parquet file with streaming using Polars with Rust?
Goal
I want to write a function in Rust using the Polars crate that does the following:
Copy a Parquet file from one location to another
Handle files larger than RAM
Not load the entire file into ...
- 459
-6
votes
0
answers
65
views
FFmpeg recording freezes mid recording and remainder of the footage is missing [closed]
I've been trying to make an application for the past couple months, which will automatically record your screen, however I notice an issue my users have been reporting, and I'm just unsure how to deal ...
- 1
Best practices
0
votes
2
replies
98
views
Memory accounting and quotas for subtasks in golang programs
If I have a server written in golang that processes requests containing user queries, is there any viable method to track and limit the memory used by any given user request?
The server process does ...
- 329k
2
votes
1
answer
63
views
Does `jax` compilation save runtime memory by recognizing array elements that are duplicated by indexing
Consider the example code:
from functools import partial
from jax import jit
import jax.numpy as jnp
@partial(jit, static_argnums=(0,))
def my_function(n):
idx = jnp.tile(jnp.arange(n, dtype=int)...
- 539
0
votes
0
answers
33
views
Confused by Valgrind Massif output - appears memory allocated under "free"
I'm attempting to use Massif to profile heap usage of an application. I'm running with the --pages-as-heap=true option and am confused by some output I'm seeing. Specifically I'm seeing allocation by ...
- 549
2
votes
3
answers
292
views
Trying to create Buffer overflow for an example for school in C++
I'm trying to do the very basics of a buffer overflow, nothing illegal at all. My understanding of the code below is that the overflowing buffer doesnt hold enough space for all the data being written,...
- 31
1
vote
1
answer
60
views
Handling cleanup for tasks which might be OOMKilled
I have some Python code running in k8s which in some cases is being OOMKilled and not leaving me time to cleanup which is causing bad behavior.
I've tried multiple approaches but nothing seems quite ...
- 175
-1
votes
0
answers
54
views
spark 3 is dropping cached fractions from memory
Im using Spark3 and Im observing that the cached partitions are getting dropped from memory.
This is what Im doing:
caching a df
applying a filter on the cached df, assigning the result into a new df ...
- 9
3
votes
2
answers
139
views
.NET 8 console application slower after publish
I am confused why my application is somehow slower when I run it by executing the .exe file from the publish folder, compared to running it from Visual Studio debugger (F5).
I use .NET 8.0 and this is ...
- 586
0
votes
0
answers
30
views
java spring application - unhealthy heap behaviour
So i have a very relatively simple java application spring 2.3.7 on java 8 that microservice simply calls DB to save update or retrive base64 image string thats all.
So i have deployed that in my ...
0
votes
0
answers
38
views
Is there a performance difference between writing bytes to RAM instead of longs?
My single threaded program allocates and initializes a volatile block of memory on an unspecified hardware architecture.
It then writes into this block in a loop using a stride equal to the cache line ...
- 33k
0
votes
0
answers
42
views
H2O-3 Calling a lot of GC calls in java when trying to load CSV file with 16M rows
I am using h2o-3 java repo to load this frame but have been running into memory issues with constant GC pressure.
The actual frame size is 3.31 GB as per h2o logs, but the peak JVM usage comes to be ...
0
votes
1
answer
74
views
Duckdb Wasm limitation
I don't know how to check or increase the memory limitation of duckdb wasm.
I'm using chrome and I import some parquet into the browser, one of them has 234Mb of data
I did my research and the limit ...
- 1
-2
votes
1
answer
123
views
Is this a valid JavaScript approach for sorting large arrays of unique integers efficiently? [closed]
I’m experimenting with sorting large arrays of unique integers in JavaScript and came up with a simple approach. I’m curious if it’s a recognized pattern or if there are potential pitfalls I might be ...
- 1