In order to improve taxing safety of large aircraft under poor weather, an obstacle detection and recognition system were proposed. An infrared camera is employed to capture heat image of obstacles. Distances of obstacles are estimated by improved stereo vision algorithm. Types of obstacle are recognized by fuzzy logic and fusion of position information. The field test indicates that the proposed system can be used to detect and recognize obstacles in the field.