Since 2560 BCE, there have been only three buildings that were the tallest buildings in the world that no longer exist. The three are:

(a) Old St Paul’s Cathedral, London, 489 ft, built 1087–1314, destroyed in the Fire of London, 1666.

(b) Singer Building, 1908–1909, destroyed to make US Steel Bldg in the 1960s

(c) World Trade Center, built in the 1970s, destroyed in Sept. 2001

There are only three buildings since 2560 BCE that were the tallest building in the world but no longer exist: (a) Old St Paul's; (b) the Singer Building; and (c) the World Trade Center.

The claim that every other tallest building in the world still exists is based on the fact that from 2560 BCE until the Lincoln Cathedral was finished in c. 1300, the tallest building in the world was the Great Pyramid of Giza. Since both the pyramid and the Lincoln Cathedral still exist, Old St Paul’s must be the first tallest building in the world to be destroyed. Since then, there have only been two others.

That is amazing.

Sources:
Wikipedia: tallest buildings in the world and Great Pyramid of Giza