Conformance Test Results

Previous: GNU Lesser General Public License

Up: Contents

Note:
Due to time constraints and pending large changes that would signficantly impact these results, this table has not been updated for the current release of OpenVRML.

About

The NIST VRML Test Suite is not a complete assessment of conformance to the VRML97 specification; it does, however, provide some indication of feature coverage and it can suggest whether a feature is basically in working order.

Assessment protocol

A test is said to pass if and only if it renders completely as intended. This is probably the least subjective means of assessment; however, it means that in some cases a test may fail due to factors unrelated to the feature that was intended to be tested.

Test problems

Several of the tests in the test suite have some kind of problem. In many cases the test is still usable in spite of the problem; in other cases it is not. Instances of the latter case are marked as "invalid" in the result table. An attempt has been made to note problems with the tests in the endnotes following the primary result table.

Summary

Overall

Total Number of Tests

796

Total Passed

558

Total Failed

221

Total Invalid

17

By Group

Node Group

Total

Pass

Fail

Invalid

Appearance

186

144

42

Bindable Nodes

93

53

27

13

Geometric Properties

53

39

14

Geometry

113

98

15

Grouping Nodes

52

38

11

3

Interpolators

30

20

10

Lights

92

70

22

Misc

50

19

31

Sensors

81

61

20

Sounds

28

0

28

Special Groups

18

16

1

1

Summary By Node

Node

Passed

Failed

Invalid

Anchor

7

2

3

Appearance

9

3

AudioClip

0

19

Background

13

2

8

Billboard

4

2

Box

6

0

Color

15

6

ColorInterpolator

4

1

Collision

1

7

Cone

8

0

Coordinate

5

0

CoordinateInterpolator

4

1

Cylinder

9

0

CylinderSensor

9

2

DirectionalLight

18

10

ElevationGrid

9

5

EXTERNPROTO

0

18

Extrusion

13

4

Fog

21

0

FontStyle

3

3

1

Group

2

0

ImageTexture

30

4

IndexedFaceSet

20

1

IndexedLineSet

9

1

Inline

4

1

1

LOD

6

0

Material

23

6

MovieTexture

0

39

NavigationInfo

14

10

2

Normal

7

2

NormalInterpolator

4

1

OrientationInterpolator

4

1

PixelTexture

9

8

PlaneSensor

11

3

PointLight

24

5

PointSet

4

1

PositionInterpolator

4

1

PROTO

17

13

ProximitySensor

9

1

ScalarInterpolator

0

5

Script ECMAScript

0

0

Script Java

0

0

Shape

4

1

Sound

0

9

Sphere

6

0

SphereSensor

5

4

SpotLight

28

7

Switch

6

0

Text

10

2

TextureCoordinate

12

6

TextureTransform

34

12

2

TimeSensor

12

7

TouchSensor

6

3

Transform

24

0

Viewpoint

10

10

3

VisibilitySensor

9

0

WorldInfo

2

0


Results

Node Group

Node

Test
Number

Result

Related Tasks

Related Bugs

Appearance

Appearance

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

-

464211

11

-

12

-

FontStyle

1

+

24095

211349

2

+

24095

211349

3

-

24095

211349, 933104

4

-

24095

211349, 933106

5

+

24095

211349

6

-

24095

211349, 933108

7

x1

ImageTexture

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

-

933532

13

-

933535

14

+

15

+

16

+

17

+

18

+

19

-

933532

20

-

933535

21

+

22

+

23

+

24

+

25

+

26

+

27

+

28

+

29

+

30

+

31

+

32

+

33

+

34

+

Material

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

-

464265

12

-

464265

13

+

14

+

15

+

16

+

17

+

211349

18

+

19

+

20

-

18753

213951

21

-

18753

213951

22

+

23

+

24

+

25

+

26

+

27

+

28

-

18753

213951

29

-

18753

213951

MovieTexture

1

-

964744, 964745

2

-

964744, 964745

3

-

964744, 964745

4

-

964744, 964745

5

-

964744, 964745

6

-

964744, 964745

7

-

964744, 964745

8

-

964744, 964745

9

-

964744, 964745

10

-

964744, 964745

11

-

964744, 964745

12

-

964744, 964745

13

-

964744, 964745

14

-

964744, 964745

15

-

964744, 964745

16

-

964744, 964745

17

-

964744, 964745

18

-2

964744, 964745

19

-

964744, 964745

20

-

964744, 964745

21

-

964744, 964745

22

-

964744, 964745

23

-

964744, 964745

24

-

964744, 964745

25

-

964744, 964745

26

-2

964744, 964745

27

-2

964744, 964745

28

-2

964744, 964745

29

-2

964744, 964745

30

-2

964744, 964745

31

-2

964744, 964745

32

-

964744, 964745

33

-

964744, 964745

34

-

964744, 964745

35

-

964744, 964745

36

-

964744, 964745

37

-

964744, 964745

38

-

964744, 964745

39

-

964744, 964745

PixelTexture

1

+

2

+

3

+

4

-

466479

5

+

6

-

466484

7

-

8

-

466484

9

-

466484

10

+

11

-

933532

12

-

13

+

14

-

15

+

16

+

17

+

TextureTransform

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

+

13

-

965478

14

-

965478

15

+

16

+

17

+

18

+

19

+3

20

+

21

+

22

+

23

+

24

+

25

+

26

+

27

+

28

+

29

-

965478

30

-

965478

31

+

32

-

33

+

34

+

35

+

36

-

466484

37

-

466484

38

+

39

-

466484

40

+

41

x4

42

+

43

x5

44

+6

45

-

965478

46

-

965478

47

-

466484

48

-

466484

Bindable Nodes

Background

1

+

2

+

3

x7

4

+

5

-

6

+

7

+

8

+

210070

9

+

210070

10

+

210070

11

+

210070

12

+

210070

13

+

210070

14

-

210070

15

x8

16

x8

17

x8

18

x8

19

x8

20

x8

21

x8

22

+

23

+

Fog

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

+

13

+

14

+

15

+

16

+

17

+

18

+

19

+

20

+

21

+

NavigationInfo

1

-

18156

211327

2

+

3

+

4

+

5

+

6

-

7

+2

8

+

9

x9

10

-

11

-

12

-

18156

211327

13

-

18156

211327

14

-

18156

211327

15

+

16

+10

17

-

18156

211327

18

x11

19

-

626197

20

-

21

+

22

+

23

+

24

+

25

+

26

+

Viewpoint

1

+

2

-12

3

-

4

-

5

+

6

+

7

x1

8

x13

9

x13

10

-

11

-

12

-

13

-

14

-14

15

-

16

-

17

+

18

+

19

+

20

+

21

+

22

+

23

+

Geometric Properties

Color

1

+

2

+

3

+

4

-

5

+

6

+

7

-

8

+

9

+

10

+

11

-

12

+

13

+

14

-

15

+

16

+

17

+

18

-

19

+

20

+

21

-

Coordinate

1

+

2

+

3

+

4

+

5

+

Normal

1

+

2

-

3

+

4

+

5

+

6

-

7

+

8

+

9

+

TextureCoordinate

1

+

2

+

3

+

4

+2

5

+2

6

+2

7

+

8

-

9

-

10

+

11

+

12

+

13

+

14

+

15

+

16

-

17

-

18

-

Geometry

Box

1

+

2

+

3

+

4

+

5

+

6

+

Cone

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

Cylinder

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

ElevationGrid

1

+

2

+

3

+

4

+

5

-

6

-

7

-

8

-

9

+

10

+

11

+

12

+

13

+

14

+

Extrusion

1

+

2

+

3

+

4

+

5

+

6

+

7

-

8

+

9

+

10

+

11

+

12

+

13

-

14

-

15

-

16

+

17

+

IndexedFaceSet

1

+

2

+

3

+

4

+

5

+

6

+15

7

+

8

+

9

+

10

+

11

+

12

+

13

+

14

-

15

+

16

+

17

+16

18

+16

19

+

20

+

21

+

IndexedLineSet

1

+

2

-

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

PointSet

1

+

2

+

3

+

4

+

5

-

Shape

1

+

2

+

3

+

4

+

5

-

Sphere

1

+

2

+

3

+

4

+

5

+

6

+

Text

1

+

2

+2

3

+

4

+

5

+

6

+

7

+

8

-2

9

+

10

+17

11

+

12

-

Grouping Nodes

Anchor

1

+

2

+

3

-

4

+

5

+

6

x18

7

x19

8

+

9

-

10

x20

11

+

12

+

Billboard

1

+

2

+

3

+

4

-

5

+

6

-

Collision

1

-

2

+

3

-

4

-

5

-

6

-

7

-

8

-

Group

1

+

2

+

Transform

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

+

13

+

14

+

15

+

16

+

17

+

18

+

19

+

20

+

21

+

22

+

23

+

24

+

Interpolators

ColorInterpolator

1

+

2

+

3

+

4

-

5

+

CoordinateInterpolator

1

+

2

+

3

+

4

-

5

+

NormalInterpolator

1

+

2

+

3

+

4

-

5

+

OrientationInterpolator

1

+

2

+

3

+

4

-

5

+

PositionInterpolator

1

+

2

+

3

+

4

-

5

+

ScalarInterpolator

1

-

2

-

3

-

4

-

5

-

Lights

DirectionalLight

1

+

2

+

3

+

4

+

5

+

6

+

7

-

8

+

9

+

10

+

11

-

12

-

13

-

14

-

15

-

16

-

17

-

18

-

19

-

20

+

21

+

22

+

23

+

24

+

25

+

26

+

27

+

28

+

PointLight

1

+

2

+

3

-

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

+

13

+

14

-

15

-

16

+

17

+

18

+

19

+

20

+

21

+

22

+

23

+

24

+

25

+

26

+

27

+

28

-

29

-

SpotLight

1

+

2

+

3

-

4

+

5

+

6

+

7

+

8

+

9

+

10

+

11

+

12

+

13

+

14

+

15

+

16

-

17

-

18

+

19

+

20

+

21

+

22

+

23

+

24

+

25

+

26

+

27

+

28

+

29

+

30

-

31

-

32

+

33

+

34

-

35

-

Misc

EXTERNPROTO

1

-

2

-

3

-

4

-

5

-

6

-

7

-

8

-

9

-

10

-

11

-

12

-

13

-

14

-

15

-

16

-

17

-

18

-

PROTO

1

+

2

+

3

+

4

+

5

+

6

+

7A

-21

7B

-21

7C

-21

7D

-21

7E

+21

7F

-21

7G

+21

7H

+21

7I

-21

7J

-21

7K

-21

8

+

9

-

10

+

11

+

12

-

13

+

14

+

15

-

16

+

17

+

18

+

19

-

20

-

Script ECMAScript

Script Java

WorldInfo

1

+

2

+

Sensors

CylinderSensor

1

+

2

+

3

-

4

+

5

+

6

+

7

+

8

+

9

+

10

-

11

+

PlaneSensor

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

10

-

11

-

12

+

13

+

14

-

ProximitySensor

1

+

2

+

3

+

4

+

5

-

6

+

7

+

8

+

9

+

10

+

SphereSensor

1

+

2

-

3

-

4

-

5

-

6

+

7

+

8

+

9

+

TimeSensor

1

-

2

+

3

-

4

+

5

-

6

-

7

+

8

-

9

-

10

+

11

+

12

-

13

+

14

+

15

+

16

+

17

+

18

+

19

+

TouchSensor

1

+

2

+

3

+

4

+

5

-

6

-

7

-

8

+

9

+

VisibilitySensor

1

+

2

+

3

+

4

+

5

+

6

+

7

+

8

+

9

+

Sounds

AudioClip

1

-

2

-

3

-

4

-

5

-

6

-

7

-

8

-

9

-

10

-

11

-

12

-

13

-

14

-

15

-

16

-

17

-

18

-

19

-

Sound

1

-

2

-

3

-

4

-

5

-

6

-

7

-

8

-

9

-

Special Groups

Inline

1

+

2

+

3

-

4

x22

5

+

6

+

LOD

1

+

2

+

3

+

4

+

5

+2

6

+

Switch

1

+

2

+

3

+

4

+

5

+

6

+

1 There are syntax errors (quoting problems) with the vrmlstring used in the script code.

2 No expected results.

3 Rear view picture missing in expected results.

4 Test file has a syntax error: multiple definitions for "textureTransform" field. Also, expected results for the bottom view are incorrect.

5 Test file has a syntax error: multiple definitions for "textureTransform" field. Expected results for top and bottom view are incorrect.

6 Expected results incorrect for top, bottom, left and right views.

7 Comments for world state, "THE SECOND BACKGROUND IS NOT FORCED TO BE THE ACTIVE BACKGROUND BY SENDING A TRUE EVENT TO IT, BUT BY SENDING A FALSE EVENT TO THE BACKGROUND AT THE TOP OF THE STACK." The problem is that the second background should never be bound unless a true event is sent to it as only the first background is bound by default. See comments on Bug 210036 in SourceForge for more information.

8 PNG missing on server.

9 Test is for NavigationInfo node but there is no NavigationInfo node in the world! Comments for test indicate there should be one that sets the speed to 1 (comments also indicate there should be a Viewpoint node in the world too but that's also missing!)

10 Test description indicates that there should be text displayed in the upper corner of the world but the expected results do not show this text.

11 url field of anchor should be "#Top_View" not "Top_View".

12 Test description erroneously states the expected position to be 0 0 -1. It should be 0 0 -10.

13 url field of anchor should be "#Top_View" not "Top_View". (Comment at top of test even says this is what the url should be!)

14 The test description indicates that the text at the top of the world should indicate right viewpoint is bound when mouse is over the box. However, sample output shows front viewpoint still bound.

15 Expected results are incorrect for rear view. Should be green on left and red on right.

16 Expected results are incorrect. Rear view should match front view.

17 Text is placed behind avatar for some reason so it cannot be seen unless you back up first. Transform should be changed to use a negative Z-val.

18 url field of anchor should be "#view2" not "view2".

19 url field of anchor should be "#view3" not "view3".

20 url field is hardcoded to point at an older location of the NIST VTS (autumn.ncsl.nist.gov) which refuses requests.

21 "Next test" text in each world points at a non-existent CGI script at http://xsun.sdct.itl.nist.gov/~mkass/vts/html/write_list.cgi.

22 URL points to old server http://autumn.ncsl.nist.gov which no longer allows access. World should be updated to point at the current location of the NIST tests.

Previous: GNU Lesser General Public License

Up: Contents