Your limit is really just going to be hardware (probably disk space) more than anything. MySQL can handle many, many billions of records in a single table without any problems.
Obviously think about your data types too - billions of rows in a table with two int columns is not too huge - but billions of rows with longtext/varchar fields are going to cause a bigger problem.....
There is no hard limit. Some OS's/filesystems have a 4-8gb limit on filesizes. So that will be one limit. Other than that, it will be how big your disk is, etc. Keep in mind, it doesn't matter how long a query take, if you're worried about SIZE .. only the size of your disk (harddrive) + the OS/filesystem is going to affect your SIZE of the database. You might want to have a look at innoDB instead of myISAM