simonko912/simllama-1.1-base

Simllama 1.1 Base model

Training

Training was stopped at around 310 hours using a 4090.
We want to minimize our carbon footprint so we used solar and only trained durning the day.
Dataset was a mix of 40gb finewebedu and 10gb pile, but only a small portion (124k steps was used for training.
This is step 124000, with a loss around 2.8-2.9.

Examples

Note: These examples ware cropped to save space, and I didnt cherry pick examples.
PROMPT: Google

's new Google Maps feature could help curb the spread of disease.
Researchers at Google say it's possible to use Google Maps to track the spread o
f infectious diseases such as measles and pneumonia.
"This is a big step forward in understanding how the spread of disease is spread
," said Michael H. Patterson, professor of microbiology, in a statement.
The research was published online Feb. 10 in the journal Science.
"There's no cure for the spread of disease," Patterson said. "In fact, we're sti
ll a long way from understanding what's going on."
The study, which was published in the journal Science, found that the number of
cases in the United States rose dramatically from 2010 to 2013, compared with 20
11.

PROMPT: Cats

 are always a favorite subject in the home, but they are also a favorite toys for children. But how do you teach your kitty to play with toys?
- Encourage your kitty to play with toys and games. If your kitty is a little too ambitious, it might be time to introduce toys. You can also use the same play-by-playing approach that your cat likes to play w
ith other dogs.
- Try to make your kitty play toys with a few basic household items. This will give her more independence.
- Use a toy like a toy or a dog. It can be a pet, dog, or toy.
- Use a toy like a dog or dog. If your kitty likes to play with other dogs, she may want to add to her play.
- Avoid using toys that are made of plastic, plastic or even wooden. They can attract pets who are prone to biting.
- Make your kitty play toys with toys.

PROMPT: Hello

 ,
I am new to this topic and am new to this topic.
I am working on an iPhone app using a touch screen.
I am trying to create a touch screen in a touch screen using the touch screen interface.
In my android studio I have a touch screen with touch screen.
My touch screen looks like this:
public void touch(View view) {
    Touch screen = (Touch) view;
}
<input name="TouchScreen" type="text" name="TouchScreen" value="true" />