Victoria's health minister Jill Hennessy said she was "physically shaken" while watching the six-minute video, and wrote to the Chiropractic Board of Australia and the Australian Health Practitioner Regulation Agency calling for action.
Australian Medical Association president Brian Owler was among critics, calling the practice "not only ridiculous but unsafe".
President of the Royal Australian College of General Practitioners told news.com.au there was "absolutely no basis" for this "outlandish" treatment on a newborn baby.
Dr Rossborough has previously defended his actions, saying he was "not putting a force in the body that the baby can't handle".
He has denied he actually "cracked" the baby's back, and defended "reducing the pressure in the fluid within a joint".
Dr Rossborough could face tougher penalties, with the Chiropractic Board of Australia expected to hold a hearing into his conduct on or before June 2.