Rudd quit after she admitted unintentionally misleading Parliament over the existence of deportation targets, which critics believe contributed to the plight of the Windrush generation.
Answering questions in the House of Commons yesterday, just hours after his appointment was announced, Javid distanced himself from language used around immigration, describing the hostile environment as "unhelpful"and not representative of British values.
He also revealed he has requested more information from officials about how targets were set and used, and told MPs he would make a decision about their effectiveness in the coming weeks.
It came as May, who stands accused of using Rudd as a "human shield" to protect her reputation over the crisis, admitted she had been aware of targets during her time in the Home Office.
Rudd's inability to confirm the use of quotas for removing illegal immigrants prompted her decision to resign on Sunday after she told MPs on the Home Affairs select committee they did not exist, before being told by officials they do.
May said; "When I was Home Secretary, yes, there were targets in terms of removing people from the country who were here illegally.
"This is important. If you talk to members of the public, they want to be reassured that we are dealing with people who are here illegally."
Critics have warned the Prime Minister must be held accountable for her role in the scandal, amid claims she set the tone for the department which Rudd was unable to shift out of fear her boss would not agree.
However, Javid gave a clear signal yesterday that he is prepared to challenge the Prime Minister's record in office after he vowed to be his own man.
Boles asked pointedly if Mr Javid would be prepared to set a new tone, telling the new Home Secretary that every Tory MP felt the same.
He added: "If that means retiring some legacy policies then so be it."
Javid, who has previously spoken of the need to have a skills-based immigration policy, replied: "Mr Boles, having worked with me in a previous department, will know that every department I've worked in I've almost certainly been putting on my own stamp."
He also vowed not to use the term "hostile environment" and use "compliant environment" instead, a decision Rudd also made over the last few days.
He said: "I don't like the phrase 'hostile' so I think the terminology is incorrect. I think it is a phrase that is unhelpful and it does not represent our values as a country. So it's about a compliant environment.
"It was a process that was begun under previous governments, it's continued but it's right we make a big distinction between those that are here legally and those who are illegal."
Javid also told MPs: "I want to start by making a pledge, a pledge to those from the Windrush generation who have been in this country for decades and yet have struggled to navigate through the immigration system: This never should have been the case and I will do whatever it takes to put it right."
