I'm using test files ~25GB as input, the allocation is ~1.5GB. I tried to profile the application, but found not too much. The (:) allocates the most memory and consume the most processor time.
LAca <rizso...@gmail.com> writes: > Can anyone give me a hint where to look at?
My first instinct would be to look hard at the map operations you have: I've had some laziness surprises from those in the past. I'm guessing that the Map.insertWith only deals with small values anyway? Are you sure that the foldWithKey is as strict as you hope? If anyone else suggests anything, they're probably more likely to be correct than I am, I've just learned to view Map stuff with suspicion whenever I'm tracking down space leaks.
LAca wrote: > I'm trying to create a simple application, which parses CPP output > files and creates a graphviz dot file. You can find the source here:
> I'm using test files ~25GB as input, the allocation is ~1.5GB. I tried > to profile the application, but found not too much. The (:) allocates > the most memory and consume the most processor time.
> Can anyone give me a hint where to look at?
If you do random access, using arrays might improve performance dramatically. Singly linked lists are really slow.
> LAca wrote: > > I'm trying to create a simple application, which parses CPP output > > files and creates a graphviz dot file. You can find the source here:
> > I'm using test files ~25GB as input, the allocation is ~1.5GB. I tried > > to profile the application, but found not too much. The (:) allocates > > the most memory and consume the most processor time.
> > Can anyone give me a hint where to look at?
> If you do random access, using arrays might improve performance > dramatically. Singly linked lists are really slow.
|
