Roger Ordish explained that while he was aware of Savile's "predilection for younger females", he believed there had been "nothing obscene" about the DJ's behaviour.
He told ITV"s This Morning today (October 16): "I didn't see anything and nothing was reported to me.
"He slept in a bedroom next to my 14-year-old daughter and I hope that is some indication that we had no suspicions of anything of this nature at all."
Asked by presenters Phillip Schofield and Holly Willoughby why he was not concerned by reports of Savile's behaviour at the time, Ordish replied: "You hear rumours about everybody famous, there must be rumours that go around about you two."
He continued: "There's such overwhelming evidence that these things happened, that they can not all have been fabricated.
"But Jimmy Savile was a very clever man and he seems to have succeeded in hoodwinking a prime minister, the Vatican, the civil police forces, the NHS hospitals up and down the country and some members of the BBC staff, including me. I'd say he was a manipulative man."
Ordish's comments come amid reports from The Sun that four people who worked with Savile on Top of the Pops were allegedly involved in "horrific and inappropriate" acts against young girls.
Jon Bird, acting operations manager of The National Association for People Abused in Childhood, said that none of the accused were famous faces or presenters on the BBC show.
Savile is alleged to have committed acts of sexual abuse towards an estimated 60 victims across six decades.
Culture Secretary Maria Miller has confirmed that there will be no government inquiry into the BBC's handling of the allegations against Savile alongside those announced by the corporation itself.
