The mosque, built in 1728 during the Dutch Occupation is the oldest mosque in the country. Its unique architectural style is a unique blend of Sumatran, Hindu and Western architecture.

All of the building's original wooden structures except the four main pillars and the roof structure has been replaced with concrete. Within its compound rests the grave of Sayyid Abdullah Al-Haddad, a famous religious teacher whom many regarded as a "Wali" (Saint).

A good way to see the Kampung Hulu Mosque is to include it as part of your walking tour of nearby Jonker Street.