Ex-Portsmouth chairman Milan Mandaric tells a court payments made to Harry Redknapp were "not a major factor in my life".