【问题标题】:Generating fake data to populate database生成虚假数据以填充数据库
【发布时间】:2020-11-12 15:02:42
【问题描述】:

我正在尝试使用 factory boy 和 faker 为我正在构建的网站生成一些虚假数据。这是我的models.py:

# External Imports
from django.db import models
import uuid

# Internal Imports
from applications.models.application import Application
from users.models.user import User
from .session import Session

# Fake data
import factory
import factory.django
import factory.fuzzy
from datetime import datetime
from faker import Faker
from faker.providers import BaseProvider
import random


class ButtonClick(models.Model):
    """**Database model that tracks and saves button clicks for an application**
    """
    # identifier
    id = models.UUIDField(default=uuid.uuid4, primary_key=True, editable=False)

    # info
    button_name = models.CharField(max_length=128, null=True, blank=True)
    application = models.ForeignKey(
        Application, related_name='button_clicks', null=True, blank=True, on_delete=models.CASCADE)
    user = models.ForeignKey(
        User, related_name='button_clicks', null=True, blank=True,      on_delete=models.CASCADE)
    session = models.ForeignKey(
        Session, related_name='button_clicks', null=True, blank=True, on_delete=models.CASCADE)
        timestamp = models.DateTimeField(auto_now=True)

class Meta:
    db_table = 'button_clicks'
    ordering = ('-timestamp', )

def __str__(self):
    return f'{self.application} - {self.button_name}'

fake = Faker()
faker = Factory.create()


class ApplicationFactory(factory.DjangoModelFactory):
    class Meta:
        model = Application

    application = factory.LazyAttribute(lambda _: faker.word())


class FakeButtonClick(factory.django.DjangoModelFactory):
    class Meta:
        model = ButtonClick

    button_name = factory.Faker('first_name')
    application = factory.SubFactory(ApplicationFactory)
    user = factory.Faker('name')
    session = factory.Faker('random_int')
    timestamp = factory.Faker('date')

当我尝试在终端中运行以下代码时,出现错误:

>>> from analytics.models.button_click import FakeButtonClick
>>> for _ in range(200): FakeButtonClick.create()
... 

Traceback (most recent call last):
  File "<console>", line 1, in <module>
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/base.py", line 564, in create
    return cls._generate(enums.CREATE_STRATEGY, kwargs)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/django.py", line 141, in _generate
    return super(DjangoModelFactory, cls)._generate(strategy, params)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/base.py", line 501, in _generate
    return step.build()
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/builder.py", line 279, in build
    kwargs=kwargs,
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/base.py", line 315, in instantiate
    return self.factory._create(model, *args, **kwargs)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/factory/django.py", line 185, in _create
    return manager.create(*args, **kwargs)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/django/db/models/manager.py", line 82, in manager_method
    return getattr(self.get_queryset(), name)(*args, **kwargs)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/django/db/models/query.py", line 431, in create
    obj = self.model(**kwargs)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/django/db/models/base.py", line 482, in __init__
    _setattr(self, field.name, rel_obj)
  File "/Users/ryan/bloks/bloks-backend/venv/lib/python3.7/site-packages/django/db/models/fields/related_descriptors.py", line 219, in __set__
    self.field.remote_field.model._meta.object_name,
ValueError: Cannot assign "9714": "ButtonClick.application" must be a "Application" instance.

我过去使用 factory boy 和 faker 创建了一些非常简单的数据,但回溯似乎暗示我需要在我的 FakeButtonClick 类中创建一个应用程序实例?我检查了文档,应用程序似乎不是工厂男孩/伪造者的可用实例。我需要自己创建实例吗?也许是一个子工厂?

【问题讨论】:

  • 是的,你需要有一个Application的子工厂...
  • 谢谢,@Iain。你为我指明了正确的方向。

标签: python django django-rest-framework faker factory-boy


【解决方案1】:

这是我的数据库填充文件,可能会对您有所帮助(比我相信的文件简单得多):

# Don't change the format. Order matters!

import os
os.environ.setdefault('DJANGO_SETTINGS_MODULE', 'project.settings')

import django
django.setup()

import random
from faker import Faker

from todo.models import Todo


fakegen = Faker()

def populate(N = 10):
    for entry in range(N):
        fake_tmp = fakegen.catch_phrase()
        levels = ['important', 'normal', 'unimportant']

        fake_title = fake_tmp if len(fake_tmp) <= 40 else (fake_tmp[:37] + '...')
        fake_desc = fakegen.sentence(nb_words=70)
        fake_level = levels[random.randint(0, 2)]

        todo_item = Todo.objects.get_or_create(title=fake_title, desc=fake_desc, level=fake_level)

if __name__ == '__main__':
    print('Populating data...')
    populate(20)
    print('Populating complete')

【讨论】:

    【解决方案2】:

    您的 ButtonClick 模型有 3 个字段定义为 ForeignKey:application、user 和 session。

    当您想要创建 ButtonClick 实例时,Django 要求您为定义为 ForeignKey 的每个字段提供一个有效值——在这里,这意味着提供模型实例或 None(因为这些 ForeignKey 可以为空)。

    使用 FactoryBoy,这意味着您必须:

    1. 为每个模型定义一个Factory 类。
    2. 使用factory.SubFactory 指向每个字段的工厂。

    一个例子是:

    
    class UserFactory(factory.django.DjangoModelFactory):
        class Meta:
            model = User
        username = factory.Faker('username')
    
    class SessionFactory(factory.django.DjangoModelFactory):
        class Meta:
            model = Session
        uuid = factory.Faker('uuid4')
        user = factory.SubFactory(UserFactory)
    
    class ApplicationFactory(factory.django.DjangoModelFactory):
        class Meta:
            model = Application
        name = factory.Faker('name')
    
    class ButtonClickFactory(factory.django.DjangoModelFactory):
        class Meta:
            model = ButtonClick
        user = factory.SubFactory(UserFactory)
        # Ensure that click.user == click.session.user
        session = factory.SubFactory(SessionFactory, user=factory.SelfAttribute('..user'))
        application = factory.SubFactory(ApplicationFactory)
    

    你可以看看at the docs。

    顺便说一句,有了FactoryBoy的faker integration,就不用直接导入了:factory.Faker('uuid4')相当于faker.Faker().uuid4()。

    【讨论】:

    • 这很好用,除了我必须在 UserFactory 中将用户名更改为电子邮件,因为这是我的用户模型所需要的,并且必须从 SessionFactory 中删除 uuid。否则,谢谢!
    【解决方案3】:

    供未来的读者阅读! 要为django 生成假数据,您可以使用django-seed。 这是一个简单的过程,因为

    • pip install django-seed(安装 django-seed)

    • 在您的应用中的settings.py 文件中添加django_seed。

      INSTALLED_APPS = (
          ...
          'django_seed',
      )
      
    • python manage.py seed &lt;app-name&gt;

    例如:播种django的api应用python manage.py seed api --number=15

    如果需要,您还可以指定特定字段应具有的值。例如,如果你想播种 15 个 MyModel,但你需要 my_field 在所有这些上都相同,你可以这样做:

    python manage.py seed api --number=15 --seeder "MyModel.my_field" "1.1.1.1"
    

    【讨论】:

      【解决方案4】:

      这就是我将假数据生成到Django sqlite的方式

      Mackaroo website 访问该网站并填写详细信息并以任何格式(sql、json 或 csv)任何格式下载文件

      关于本网站的好处,您可以在您的列null 值 以及数字、日期等的任何格式 上提供regular expression

      然后下载它或将其转储到您的database

      【讨论】:

        猜你喜欢
        • 1970-01-01
        • 1970-01-01
        • 2017-12-09
        • 2018-09-09
        • 2018-03-14
        • 2014-12-17
        • 2023-01-15
        • 1970-01-01
        • 1970-01-01
        相关资源
        最近更新 更多