S.SHANMUGA SAMYEx. Chief General Manager| O.N.G.C.LtdChennai, Tamil Nadu, India
Can any one please share his/her experience on how he/she gave weightages towards performance measurements during a project Saving Changes...
Sort By:
Hans RobbersSenior Director| SalesforceVlissingen, Netherlands
Hi
Would you be able to clarify if it is system performance or human performance you are after?
thanks Saving Changes...
S.SHANMUGA SAMYEx. Chief General Manager| O.N.G.C.LtdChennai, Tamil Nadu, India
Hi Hans Robbers,
I mean the system performance Saving Changes...
Hans RobbersSenior Director| SalesforceVlissingen, Netherlands
Hi
A couple of things I usally agree on up front. What will be the testing environment and how does it compare to the production environment. This ratio needs to be applied as well for performance testing.
Secondly I like agree on the metrics ni terms of speed, volumes, etc. When possible per function. A batch function can be slower than a on-line function
Thirdly agree on the timeslot your application has. When there is an interface with the legacy system for on-line data agree on the performance for the appication you are developing not the total flow.
Fourth Agree on tolerances. One test is not sufficient to pass neither is one test sufficient to fail. Agree on app 25-50 tests for 1 function (to be automated) agree on the performance. 68% of the test cases shouold be within a bandwidth of 25% to either side of the average time. 92% needs to be within the bandwidth of 50% of the average performance time.
Example average performance time is 4 seconds 68% of the test cases need to be with 3 and 5 and 92 % need to be within 2 and 6 seconds.
When there is an internet connection in the flow exclude this from the test by using the intranet and make an assumption of the time required at the internet
Finally if you run with a lot of tables in cache this will also ensure this will be taken into account
Hopes this helps
good luck Hans Saving Changes...
John ZurfluehProgram Manager| GetingePompton Plains, Nj, United States
Hans makes an important point about Internet related transactions. Be careful about trying to determine a transaction time against network segments outside of your LAN. You only open yourself up to difficulties because of the significant number of variables in the management of transactions across other networks. Saving Changes...
Digvijay SinghProject Manager| Mastek LimitedPune, India
Great post Hans, the subject is very important, often ignored initially in the project and later forces project manager to pay price through extra resources or servers.
What I feel for web application project, project manager should upfront hire the tech arch who can manage the performance aspect of design and test phases.
Limited Bandwidth at production system is always a worry, so performance of the system during system testing has to be tested in similar configuration of bandwidth as well.
Although I have never used but heard of lot of tools like load runner, web load provide the required set up for testing the application. Servers can be virtualized to increase the volume/users by creating near to production environment.
I would like to hear more from others on this subject, specifically for a system to be installed at data center and to be used at 400 different locations with internet as well as intranet application. There is predefined bandwidth for network connectivity, mostly 64 kbps. Saving Changes...
