loop performance question

[pertheli]

Hello,

I have a large array of pointer to some object. I have to run test
such that every possible pair in the array is tested.
eg. if A,B,C,D are items of the array,
possible pairs are AB, AC, AD, BC and CD.

I'm using two nested for loop as below, but it is running very slow
whenever I access any data in the second loop.

I suspect, time taken to fetch the obj2 from memory is the bottleneck
Is there a way to improve the performance, or accessing data from
memory any faster in case of obj2?

Thanks in advance
Pertheli

-----------------------
// my object
struct MyObj{
double a;
double b;
};

// array of *MyObj
MyObj** objArray = new MyObj*[iMax]; // iMax = large > 20000

// create MyObj fill pointers int objArray

// for each possible pair in the array, do some testing
for (i=0; i<iMax; i++){
MyObj *obj1 = (MyObj*)objList;

for (j=i; j<iMax; j++){
MyObj *obj2 = (MyObj*)objList[j];

// do some tests
val += obj1->a; //-> very fast(same obj1)
val += obj1->b;

// same number of instruction but very slow
// accessing from different part in memory??
//val += obj1->a; //<- obj1 and obj2
//val += obj2->b; //<- Accessing any data of obj2 is very slow!
// 1/10th time slower than the above
}
}

 

[Ivan Vecerina]

Hi,
| I have a large array of pointer to some object. I have to run test
| such that every possible pair in the array is tested.
| eg. if A,B,C,D are items of the array,
| possible pairs are AB, AC, AD, BC and CD.
|
| I'm using two nested for loop as below, but it is running very slow
| whenever I access any data in the second loop.
|
| I suspect, time taken to fetch the obj2 from memory is the bottleneck
This would definitely be the case in the artificial sample you posted.
| Is there a way to improve the performance, or accessing data from
| memory any faster in case of obj2?

First advice: if you can, use a vector of objects instead of a vector
of pointers. The pointers to separately allocated objects break the
contiguity of memory accesses. Several platforms are optimized for
reading memory sequentially (as is the case with array/std::vector).
Also, make sure that your object are self-contained and do not contain
pointers to separately stored data (incl. containers or std::string).
This step is important for further optimizations, it is worth the
extra effort (even if you need a first pass to translate the data).

Next, I'll assume that this has to be an O(N2) problem: that you have
excluded alternative algorithms, or the possibility of pre-sorting the
objects in a way that allows to select a subset of object pairs to be
tested (e.g. geometrical clusters for collision detection, etc).

Then comes the question of how to avoid cache misses when accessing obj2.
The basic idea would be to compare sets of objects that simultaneously
fit into the processor cache.
This could be achieved with a loop such as:
const int pageStep = 10;
for( i=0; i<iMax; ) { // 1
iEnd = i+pageStep; if(iEnd>iMax) iEnd=iMax;
for( j=i; j<iMax; ) { // 2
jStart = j; // as in your code, self-comparison assumed desireable
jEnd = i+pageStep; if(jEnd>iMax) jEnd=iMax;
for( ; i<iEnd ; ++i ) { // 3
MyObj& obj1 = objList;
for( j=jStart ; j<jEnd ; ++j ) { // 4
MyObj& obj2 = objList[j];
//... do stuff
}
if( jStart==i ) ++jStart; // for first iteration of loop 2
}
}
}
//Note: typed on-the-fly, not tested

Loops 3+4 compare objects pairs across two subsets of contiguous
objects, which are selected by loops 1+2.
Increasing the pageStep value will eventually improve performance
until the contiguous subsets are too large to fit in the cache
(or rather: one of the caches) - you may want to play with this.
The addition of some loop unrolling within 3&4 could also
help performance.

This is as far as I would go in C/C++: the code quickly gets
complicated, and the optimization is already platform-specific.

You should also try to use a specialized/optimizing compiler
(e.g. intel C++ on the x86 platform). Then look into the
assembly code itself...


This was to answer your specific question. But as always, it is
often more effective to choose a faster approach to a problem
than to tune code...

I hope this helps,
Ivan

 

[Michael Mellor]

Hello,

I have a large array of pointer to some object. I have to run test
such that every possible pair in the array is tested.
eg. if A,B,C,D are items of the array,
possible pairs are AB, AC, AD, BC and CD.

I'm using two nested for loop as below, but it is running very slow
whenever I access any data in the second loop.

I suspect, time taken to fetch the obj2 from memory is the bottleneck
Is there a way to improve the performance, or accessing data from
memory any faster in case of obj2?

Thanks in advance
Pertheli

-----------------------
// my object
struct MyObj{
double a;
double b;
};

// array of *MyObj
MyObj** objArray = new MyObj*[iMax]; // iMax = large > 20000

// create MyObj fill pointers int objArray

// for each possible pair in the array, do some testing
for (i=0; i<iMax; i++){
MyObj *obj1 = (MyObj*)objList;

for (j=i; j<iMax; j++){
MyObj *obj2 = (MyObj*)objList[j];

// do some tests
val += obj1->a; //-> very fast(same obj1)
val += obj1->b;

// same number of instruction but very slow
// accessing from different part in memory??
//val += obj1->a; //<- obj1 and obj2
//val += obj2->b; //<- Accessing any data of obj2 is very slow!
// 1/10th time slower than the above
}
}

I would suspect that your compiler is optimising away the loop:

for (i=0; i<iMax; i++){
MyObj *obj1 = objList;

for (j=i; j<iMax; j++){
MyObj *obj2 = objList[j];
val += obj1->a; //-> very fast(same obj1)
val += obj1->b;
}
}

can be transformed into:

for (i=0; i<iMax; i++){
MyObj *obj1 = objList;

val += obj1->a * (iMax - i); //-> very fast(same obj1)
val += obj1->b * (iMax - i);
}

the second loop is needed once obj2 is added to the equation.

Try testing with optimisations turned off.

Michael Mellor

 

[EventHelix.com]

It doesn't seem right. Just using obj2 should slow down
things to that extent. Maybe some other stuff in the
inner loop is causing it.

Sandeep