Error Correction Tests

In the following tests we examine the reading error correction capabilities of the SONY CRX-220E1 and AOpen CRW5224.

- EAC CD-R Test Disc

- Introduction

We used the testing methodology as described in EAC website. The CD-R test disc includes 5 scratches and a black triangle defect. Using the "c2extract.exe" build-in software and with the max reading speed of each drive we ripped the disc. The attached analyse.exe software used to get the necessary results.

The graph tells a lot about the abilities of the drive. The quality of the optical system (and the error correction capabilities of the firmware) can be estimated by checking the time positions the errors start, during reading. Higher wedges mean lower error correction capabilities.

The grid of the graph has the following means:

• The X position of a grid line is always a start of a new minute position on the CD (in play time, up to 74 min).
• The Y axis shows the dB (A) value of the error in the extracted file. dB (A) is a weighting/curve that is not affected much in high and very low frequencies, but mainly in medium frequencies, using an A-weighting curve.
• The graph shows a range of 6 dB (A) down to -120.0 dB (A). Each line represents a 6 dB(A) volume. (6 dB(A) louder means that the sound is two times louder)
• " For the test CD, a wedge below -60 dB (A) is quite acceptable for error correction. Anything higher than -42 dB (A) is quite critical, and you would hear that in any case. Of course that also depends on the surrounding music/noise. For example, if the rest of the song is absolutely silent, you will probably even hear a -96 dB (A) - only by using 24 bit audio files. If it is hidden between a -6 dB of music, you will probably not hear a -72 dB (A) or even -66 dB (A)...
  

- Explanation

After the analyze.exe software finishes, we get a detailed report about various errors:

- Errors total tells about the total number of wrong stereo samples. This includes areas of wrong samples that may include some correct samples.

- Errors Loudness is the number of FFT analysis done. For that the average and maximum value tells the power difference of the two signals. No acoustic model is used for this calculation, so the audible error may differ from these values.

- Error Muting gives information about error hiding. On bad errors (or bad error hiding techniques), the last error free sample is held for some time until a new valid sample is found. The number of these mutings is given as first result, following the average and maximum sample length of these mutings.

- Skips are occurring when the sync was lost and the drive had to reposition again (and start on a slightly different position). Non-accurate stream devices would loose the sync very often and smaller and bigger skips occur (thus samples are missing or extraneous). The average and maximum values denote the length in samples of such skips.

- Total Score is calculated according to the previous errors. The higher score a drive gets the better!

The C2 error graphs of EAC measure three C2 results:

• Total number of C2 errors (of 16 bit blocks).
• Number of C2 flagged 16 bit blocks that are identical to original WAV. This is number is usually not zero, as even the drive flagged samples to be wrong, they can be with some probability corrected correctly nevertheless...
• Number of differences to the original WAV that are not C2 flagged (also 16 bit blocks)

As EAC author mentions "…This third one is the most interesting figure, it will show how much blocks are going unreported by C2 error correction...The 16 bit blocks (instead of 8-bit, the native format of C2) was because of some drives interpolate a (mono) sample, etc. but only flag the part with the read error on it (but changed both parts). Thus only 16 bit blocks are checked for consistency. It is enough if one of the two bits is flagged to accept that any of the two bytes are wrong..."

- Test Results (Max Reading)

Errors total	Num: 30743
Errors (Loudness) dB(A)	Num: 9687	Avg:-83.9 dB(A)	Max: -33.9 dB(A)
Error Muting Samples	Num: 86	Avg:1.6 Samples	Max: 6 Samples
Skips Samples	Num: 0	Avg: 0 Samples	Max:0 Samples
Total Test Result	81.5 points (of 100.0 maximum)

In the maximum ripping speed, the AOpen CRW5224 drive showed a good behaviour and got a score of 81.5 out of 100 (perfect).

Errors total	Num: 599
Errors (Loudness) dB(A)	Num: 823	Avg:-86.2 dB(A)	Max: -63.7 dB(A)
Error Muting Samples	Num: 0	Avg: 0 Samples	Max: 0 Samples
Skips Samples	Num: 0	Avg: 0 Samples	Max:0 Samples
Total Test Result	88.8 points (of 100.0 maximum)

In the maximum ripping speed, the SONY CRX-220E1 performed better and corrected the five scratches while corrected some of the data in the black triangle. It gets a score 88.8 out of 100.

- ABEX TCD-721R

- Introduction

This test disc includes artificial scratches with lengths from 1.8 mm to 3.0 mm.

Using the ABEX TCD-714 as the reference disc, we created the reference.wav file that is needed for the comparison. Using the c2extract.exe software and by setting the maximum reading speed with Nero Drive speed we ripped the disc. The attached analyse.exe software gave the comparison results.

- Test Results (Max speed)

The ABEX 721R test disc is very hard for almost all drives and the AOpen CRW5224 couldn't be an exception. The error spikes reached -11.7 dB(a) at several points, while we have an average 6.8 skipped samples. Not a good performance and a low 63.1 score.

Errors total	Num: 1189862
Errors (Loudness) dB(A)	Num: 62372	Avg:-73.4 dB(A)	Max: -11.7 dB(A)
Error Muting Samples	Num: 7364	Avg: 2.0 Samples	Max: 297 Samples
Skips Samples	Num: 0	Avg: 6.8 Samples	Max: 24 Samples
Total Test Result	63.1 points (of 100.0 maximum)

Errors total	Num: 1440376
Errors (Loudness) dB(A)	Num: 139172	Avg:-78.7 dB(A)	Max: -35.5 dB(A)
Error Muting Samples	Num:4908	Avg: 1.0 Samples	Max: 9 Samples
Skips Samples	Num: 0	Avg: .0 Samples	Max: 0 Samples
Total Test Result	75.3 points (of 100.0 maximum)

The SONY drive kept the error spikes lower than the AOpen and got a score of 75.3 out of 100.

- ABEX TCD-726

- Introduction

The ABEX TCD-726 includes three kinds of defects, interruption, black dots and fingerprints. The interruption defects are sized from 0.5 mm to 1.0 mm. The black dots are from 0.4 mm to 1.0 mm and the fingerprints range from 65 to 75 micrometers.

- Test Results (Max Speed)

The AOpen drive performed quite well and gave few errors getting an 87.6 score.

Errors total	Num: 1338
Errors (Loudness) dB(A)	Num: 349	Avg:-90.4 dB(A)	Max: -46.7 dB(A)
Error Muting Samples	Num: 4	Avg: 2 Samples	Max: 5
Skips Samples	Num: 0	Avg: 0 Samples	Max: 0 Samples
Total Test Result	87.6 points (of 100.0 maximum)

Errors total	Num: 146
Errors (Loudness) dB(A)	Num: 281	Avg:-73.1 dB(A)	Max: -24.5 dB(A)
Error Muting Samples	Num: 0	Avg: 0.0 Samples	Max: 0
Skips Samples	Num: 2	Avg: 480 Samples	Max: 480 Samples
Total Test Result	78.3 points (of 100.0 maximum)

In the maximum ripping speed, the SONY CRX220E1 got a score of 76.3 due to high number of skipped samples.

- Conclusion

Test Disc	Reading Speed	SONY CRX-220E1	AOpen CRW5224
		Score
EAC CD-R	Max	88.8	81.5
ABEX TCD-721R	Max	75.3	63.1
ABEX TCD-726	Max	76.3	87.6
Average Score		80.23	77.40

The SONY CRX220E1 got a higher overall score of 80.23, while the AOpen CRW5224 got 77.40. The EAC results are much different from the CDSpeed results due to different way of calculated errors.

- C2 Information accuracy

- Introduction

The Advanced DAE Error Correction tests are available in the latest version of Nero CD Speed. With the A-BEX TCD-721R disc, we can test the drive's C2 error information accuracy. First we created the image with the A-BEX TCD-714 test disc. Then we tested with the Advanced DAE Error Correction test, the C2 error information accuracy.

Note that the C2 accuracy test works only with drive that can report C2 errors according to the MMC standard. If the drive doesn't report C2 errors according to the MMC, but does support C2 errors, the software will give a 0 score, which is not correct, but also users couldn't use the C2 error information with any public available software (like DAE rippers).

According to the CD Speed author, the C2 accuracy should be very high (99%) to be useful. An explanation of the reported C2 errors follows:

• C2 Errors is the amount of errors reported by the drive.
• Compare Errors are the differences between the original image file and the data on the test disc.
• C2 Missed are present when the drive did not report an error while there was a difference between the image file and the test disc (ie. comparison bit to bit).

The "Quality" test score table is shown below:

• 0-50: bad
• 51-60: not so good
• 61-70: ok
• 71-80: good
• 81-90: very good
• 91-100: excellent!

- Test Results (MAX Speed)

The C2 accuracy of the AOpen CRW5224 was very bad since the drive got a 26.38% score. The quality score was also very bad with 0 score due to high sync error number (22506!). While the drive got a 0 score with the CDSpeed, the EAC results are much different. This happens since according to the CDSpeed when so many sync errors occur, C2 accuracy cannot be measured.

The C2 accuracy of the SONY CRX-220E1 was perfect since the drive got a 100% score. The quality score was very good with 84.3.

A newer version of EAC's analyser software also offers C2 accuracy %. Both results are posted below. The SONY CRX220E1 got a 99.99% C2 accuracy, while the AOpen CRW5224 got only 66.87%. The different results in C2% accuracy between the CDSpeed and EAC are

Test Disc	Reading Speed	SONY CRX-220E1	AOpen CRW5224
		Score
EAC CD-R	Max	100	66.9
ABEX TCD-721R	Max	99.8	67.0
ABEX TCD-726	Max	100	66.7
Average Score		99.9%	66.87