Most artificial neural networks today are designed specifically for particular tasks rather than simulating general brain function. In this project, we attempt to create a novel artificial neural network to simulate the role of memory formation. It carries out unsupervised learning by following Hebb's rules and incorporates a number of features that are biologically inspired. This project investigates how our network should be designed and fine-tuned for it to be a good simulation of memory formation.