Based on the original work of fast performance algorithm in detecting Indonesian license plate, the proposed work will solve the error found in the license plate localization process caused by plate like pattern within the image, which was called the ornament problem. Although not in all cases, this problem could exist when a car has banner, regular pattern, car’s front grill, that could miss understood by the system as license plate letters. The proposed work will implement filtering systems instead of machine learning approach. The filtering methods will follows three steps: detection filter based on the number of elements in the vector, based on the letter proportion of a license plate number, and based on the distance between detected letters. This approach will maintain the fast properties of the original algorithm and will increase the accuracy of localizing the license plate within the given image.