"I saw Jumanji. I liked it. I wasn't bitter enough then, now I'm bitter," she joked. By the time she lost out on The Parent Trap three years later, "I started to get bitter...it was hard for me."
Becoming an A-list star hasn't made Johansson immune from rejection, though: She unsuccessfully auditioned for Anne Hathaway's Oscar-winning role in the 2012 big screen adaptation of Les Miseables.
"I auditioned and I had laryngitis...but I tried. I don't know if that's why I didn't get it, I probably wasn't right for it," she revealed.
Stern asked her about the rumour that she'd been knocked back for the titular role in 2011 film The Girl with the Dragon Tattoo because she was "too beautiful" for the part.
"Well, that's not exactly how it went. What happened was, I remember having conversations with [director David] Fincher and he said, 'You have to look like you're totally uncaring of yourself, deprived...you're fragile...' I said, 'I will, I can be this person!' And he said 'No, you can't'."
"I really, really wanted that film because I felt I had something to contribute to it, but Fincher had a different vision for the character - and Rooney Mara's so perfect in it."
And as it turns out, landing a role isn't always a blessing. Arguably Johansson's big Hollywood breakthrough, in the 2003 cult hit Lost in Translation, saw her acting alongside comedy legend Bill Murray - an experience she now admits was difficult.
"I grew up worshipping him and I was so excited to work with him. I think we just...it was hard. It was a hard shoot for me. I was 17 years old...he's a comedian, he's quirky, and he had a lot of ups and downs. I was more introspective, I guess."
She revealed she felt somewhat invisible working alongside such a Hollywood icon.
"That's what was isolating about it, that everyone was so deferential [to him]. It was hard to relate to one another. But when the cameras rolled, we worked really well together."