While humans are mammals, and share a common ancestor with all mammals, we ultimately share a common ancestor with all animals. Sponges are the most ancient and simple form of animals, and represent a very early branch on the tree of life.
While it's hard to say definitively which *exact* species is the furthest relative, it's safe to say that sponges are the most distantly related animals to humans.