Robert Downey Jr. raised his fans’ hopes when he seemingly implied on The Ellen DeGeneres Show Monday that he will reprise his role as Tony Stark for Iron Man 4, but the acclaimed actor immediately took back his comment later that night on Late Night with David Letterman. Downey Jr. definitively stated that there are “no plans” for an Iron Man 4, and that he doesn’t anticipate that changing soon.

“I know there’s gonna be a bunch more Marvel movies, and they have big ideas of how to do it best. We’re in the middle of negotiations,” the 49-year-old actor first told Ellen Monday morning.

Upon being pressured to give a yes or no answer regarding whether fans can expect a fourth Iron Man film to happen, Downey Jr. replied with “Okay, yes.”

Later that night, however, he told Letterman that “there’s no plans for an Iron Man 4. There’s no script for Iron Man 4.” This time, when pressured to say if he thought the film could be a possibility, Downey Jr. changed his answer.

“Just between us, no. But I’m gonna do other stuff with Marvel. I’m still gonna be involved with Marvel.”

Regardless of whether a fourth Iron Man solo film ever takes place, viewers will likely still have plenty of opportunities to see Downey Jr. reprise his iconic role. Tony Stark will play a pivotal role in Avengers: Age of Ultron, which will be released on May 1, 2015. After that, the star will still have another Marvel Cinematic Universe film on his contract. He also stated in a Reddit AMA Monday that he is interested in reprising his role for an appearance on ABC’s Marvel’s Agents of S.H.I.E.L.D.”

“Nothing is impossible. I love Clark Gregg, and am pleased the show is doing so well.”