Is clearing big lists needed for performance improvements [on hold]











up vote
-1
down vote

favorite












I have a method used to collect some data and send it to external service. In previous implementation I would use my own implementation of paging and collect 100 entities at the time and synchronize it. Since my way did not work same on oracle and mysql DBs I have decided to change it to fetch all entity ids and then split it in pages and send page by page.



Currently it looks like this 



final List<String> ids = dataService.collectAllIds(user, type);



final List<List<String>> pages = Lists.partition(ids, 100);

for (int pageIndex = 0; pageIndex < pages.size(); pageIndex++) {

    final List<String> page = pages.get(pageIndex);

    // do something with page

}


After splitting it and geting pages list I do not need ids list anymore. Would it help if I clear it at this point in regards of performance ? List of ids can contain up to 1.7 million entries.






java performance memory-optimization







share|improve this question







New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











put on hold as off-topic by 200_success, Heslacher, Toby Speight, RoToRa, Mast 3 hours ago


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "Lacks concrete context: Code Review requires concrete code from a project, with sufficient context for reviewers to understand how that code is used. Pseudocode, stub code, hypothetical code, obfuscated code, and generic best practices are outside the scope of this site." – 200_success, Heslacher, Toby Speight, RoToRa, Mast

If this question can be reworded to fit the rules in the help center, please edit the question.









  • 1




    You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
    – 200_success
    9 hours ago















up vote
-1
down vote

favorite












I have a method used to collect some data and send it to external service. In previous implementation I would use my own implementation of paging and collect 100 entities at the time and synchronize it. Since my way did not work same on oracle and mysql DBs I have decided to change it to fetch all entity ids and then split it in pages and send page by page.



Currently it looks like this 



final List<String> ids = dataService.collectAllIds(user, type);



final List<List<String>> pages = Lists.partition(ids, 100);

for (int pageIndex = 0; pageIndex < pages.size(); pageIndex++) {

    final List<String> page = pages.get(pageIndex);

    // do something with page

}


After splitting it and geting pages list I do not need ids list anymore. Would it help if I clear it at this point in regards of performance ? List of ids can contain up to 1.7 million entries.






java performance memory-optimization







share|improve this question







New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











put on hold as off-topic by 200_success, Heslacher, Toby Speight, RoToRa, Mast 3 hours ago


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "Lacks concrete context: Code Review requires concrete code from a project, with sufficient context for reviewers to understand how that code is used. Pseudocode, stub code, hypothetical code, obfuscated code, and generic best practices are outside the scope of this site." – 200_success, Heslacher, Toby Speight, RoToRa, Mast

If this question can be reworded to fit the rules in the help center, please edit the question.









  • 1




    You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
    – 200_success
    9 hours ago













up vote
-1
down vote

favorite









up vote
-1
down vote

favorite











I have a method used to collect some data and send it to external service. In previous implementation I would use my own implementation of paging and collect 100 entities at the time and synchronize it. Since my way did not work same on oracle and mysql DBs I have decided to change it to fetch all entity ids and then split it in pages and send page by page.



Currently it looks like this 



final List<String> ids = dataService.collectAllIds(user, type);



final List<List<String>> pages = Lists.partition(ids, 100);

for (int pageIndex = 0; pageIndex < pages.size(); pageIndex++) {

    final List<String> page = pages.get(pageIndex);

    // do something with page

}


After splitting it and geting pages list I do not need ids list anymore. Would it help if I clear it at this point in regards of performance ? List of ids can contain up to 1.7 million entries.






java performance memory-optimization







share|improve this question







New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











I have a method used to collect some data and send it to external service. In previous implementation I would use my own implementation of paging and collect 100 entities at the time and synchronize it. Since my way did not work same on oracle and mysql DBs I have decided to change it to fetch all entity ids and then split it in pages and send page by page.



Currently it looks like this 



final List<String> ids = dataService.collectAllIds(user, type);



final List<List<String>> pages = Lists.partition(ids, 100);

for (int pageIndex = 0; pageIndex < pages.size(); pageIndex++) {

    final List<String> page = pages.get(pageIndex);

    // do something with page

}


After splitting it and geting pages list I do not need ids list anymore. Would it help if I clear it at this point in regards of performance ? List of ids can contain up to 1.7 million entries.






java performance memory-optimization




java performance memory-optimization






share|improve this question







New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.











share|improve this question







New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









share|improve this question




share|improve this question






New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.









asked 9 hours ago









mirzak

99




99




New contributor




mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.





New contributor





mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.






mirzak is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.




put on hold as off-topic by 200_success, Heslacher, Toby Speight, RoToRa, Mast 3 hours ago


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "Lacks concrete context: Code Review requires concrete code from a project, with sufficient context for reviewers to understand how that code is used. Pseudocode, stub code, hypothetical code, obfuscated code, and generic best practices are outside the scope of this site." – 200_success, Heslacher, Toby Speight, RoToRa, Mast

If this question can be reworded to fit the rules in the help center, please edit the question.




put on hold as off-topic by 200_success, Heslacher, Toby Speight, RoToRa, Mast 3 hours ago


This question appears to be off-topic. The users who voted to close gave this specific reason:


  • "Lacks concrete context: Code Review requires concrete code from a project, with sufficient context for reviewers to understand how that code is used. Pseudocode, stub code, hypothetical code, obfuscated code, and generic best practices are outside the scope of this site." – 200_success, Heslacher, Toby Speight, RoToRa, Mast

If this question can be reworded to fit the rules in the help center, please edit the question.








  • 1




    You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
    – 200_success
    9 hours ago














  • 1




    You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
    – 200_success
    9 hours ago








1




1




You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
– 200_success
9 hours ago




You seem to be asking a specific question about a practice in general (clearing lists), with a minimal excerpt that serves merely as an example. Please show your real code, in context and without placeholder comments, so that we can review it properly and give you the right advice. See How to Ask.
– 200_success
9 hours ago















active

oldest

votes






















active

oldest

votes













active

oldest

votes









active

oldest

votes






active

oldest

votes

-

Popular posts from this blog

Ellipse (mathématiques)

Image
Pour les articles homonymes, voir Ellipse. L'ellipse est le lieu des points dont la somme des distances à deux points fixes, dits foyers, est constante. Section du cône ou projection du cercle. En géométrie, une ellipse est une courbe plane fermée obtenue par l’intersection d’un cône de révolution avec un plan, à condition que celui-ci coupe l'axe de rotation du cône ou du cylindre : c'est une conique d'excentricité strictement comprise entre 0 et 1. On peut également la définir comme le lieu des points dont la somme des distances à deux points fixes, dits foyers, est constante (sa construction par la méthode du jardinier est très simple). Dans la vie courante, l’ellipse est la forme qu'on perçoit en regardant un cercle en perspective, ou la figure formée par l’ombre d'un disque sur une surface plane. On retrouve aussi, en première approximation [ 1 ] , des ellipses dans les trajectoires des corps célestes (planètes, comètes ou satellites arti...
Read more

Quarter-circle Tiles

Image
up vote 0 down vote favorite I have $99$ identical square tiles, each with a quarter-circle drawn on it like this: [asy] size(1.5cm); draw(Arc((2,0),1,90,180),red+1); draw((0,0)--(2,0)--(2,2)--(0,2)--(0,0)); [/asy] When I arrange the tiles in a $9times 11$ rectangular grid, each with a random orientation, what is the expected value of the number of full circles I form? I think this problem has to do with finding the chance any given 2x2 square has a circle, but I can't find it. expected-value share | cite | improve this question asked Nov 20 at 15:03 6minecraftninja 1 2 ...
Read more

Mont Emei

Image
Mont Emei.mw-parser-output .entete.map{background-image:url("//upload.wikimedia.org/wikipedia/commons/7/7a/Picto_infobox_map.png")} Vue du sommet Wanfo du mont Emei Géographie Altitude 3 099  m , Wanfo Coordonnées 29° 31′ 11″ nord, 103° 19′ 57″ est Administration Pays   Chine Province Sichuan Ville-préfecture Leshan Géolocalisation sur la carte : Sichuan Mont Emei Géolocalisation sur la carte : Chine Mont Emei modifier   Paysage panoramique du mont Emei, incluant le paysage panoramique du grand Bouddha de Leshan *   Patrimoine mondial de l'UNESCO Passerelle en bois sur le versant ouest Pays   Chine Subdivision Sichuan Type Mixte Critères (iv) (vi) (x) Superficie 15 400 ha Numéro d’identification 779 Zone géographique Asie et Pacifique  ** Année d’inscription 1996 (20 e session) * Descriptif officiel UNESCO ** Classification géog...
Read more