The Swans went down to a 3-1 defeat at White Hart Lane as Rafael van der Vaart and an Emmanuel Adebayor double earned Spurs victory.
Dutchman van der Vaart fired past countryman Michel Vorm after 19 minutes but the Swans hit back after the break with Gylfi Sigurdsson firing home an equaliser on 58 minutes.
But the hosts powered on to victory with Adebayor twice heading home crosses from van der Vaart and sub Aaron Lennon.
This defeat - a second on the trot for Brendan's side - meant the Swans fell to 11th in the table.
The Swans made just one change from the starting XI.
It was an enforced change at that with loanee Steven Caulker unable to face his parent club. That meant Garry Monk returned to captain the side alongside Ashley Williams in the heart of defence.
Nathan Dyer returned from suspension and was included on the bench with Wayne Routledge preferred after impressing in the three games in which Dyer was serving his ban.
Tottenham Hotspur: Brad Friedel, Gareth Bale, Younes Kaboul, Scott Parker, Emannuel Adebayor, Rafael van der Vaart (Jake Livermore, 85), William Gallas, Luka Modric, Kyle Walker, Sandro (Aaron Lennon, 71), Benoit Essou-Akoto (Danny Rose, 88).
Subs: Carlo Cudicini, Louis Saha, Jermain Defoe, Ryan Nelson.
Swans: Michel Vorm, Angel Rangel, Garry Monk (capt), Ashley Williams, Neil Taylor, Leon Britton, Joe Allen (Mark Gower, 90+1), Gylfi Sigurdsson, Wayne Routledge (Nathan Dyer, 71), Scott Sinclair, Danny Graham (Luke Moore, 78).
Subs: Gerhard Tremmel, Alan Tate, Josh McEachran, Leroy Lita.
The Swans settled into the contest well inside the opening five minutes, controlling possession and setting the tempo.
After Rafael van der Vaart went close, Wayne Routledge saw his shot from the edge of the box bounce just wide.
Neil Taylor then embarked on a superb run down the left and raced into the box before seeing his effort snuffed out for a corner.
But with 19 minutes on the clock, Spurs took the lead. Gareth Bale got onto the end of a through ball and after his cut back was half-cleared by Ashley Williams, Rafael van der Vaart sidefooted an unstoppable effort past Michel Vorm.
Younes Kaboul's header was then tipped wide by Vorm from van der Vaart's corner while, at the other end, Williams' header bounced over from a Gylfi Sigurdsson corner.
Then, after Angel Rangel's mis-pass was collected by Bale, the Welshman fired just over with a rasping shot before Luka Modric dragged his effort wide before the break.
Half-time: Spurs 1 Swans 0
The Swans were pushing for an equaliser early on and Sigurdsson looked certain to have found a breakthrough when his left-footed shot was destined for the top corner. But a superb one-handed save from Brad Friedel tipped it wide for a corner.
The Swans then got their equaliser before the hour as Joe Allen's deflected shot was chested down by Routledge to Sigurdsson, whose shot cannoned off the floor and past Friedel.
Vorm then had to be alert to push van der Vaart's near-post header from Bale's cross out for a corner, before both sides made a change.
Spurs brought Aaron Lennon on for Sandro while Nathan Dyer replaced Routledge with just under 20 minutes to go.
It made the difference for Spurs, with van der Vaart's corner being met by the head of Emmanuel Adebayor, who directed his effort into the far corner.
Another change followed for the Swans, Luke Moore coming on for Danny Graham with 12 minutes left.
Sigurdsson's dipping 30-yard free-kick then dropped a few inches wide before Vorm easily dealt with Modric's low drive.
But the game was officially over with four minutes left as sub Aaron Lennon made his first real contribution as he crossed for Adebayor, who climbed above Garry Monk to head home.