Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using Unified QA T5-large Saying ( Getting a Error ) Make Layer Stack Param Not found, #32

Closed
ayush714 opened this issue Sep 28, 2021 · 3 comments

Comments

@ayush714
Copy link

I am getting this error, by using below code:-

ValueError: Configurable 'make_layer_stack' doesn't have a parameter named 'use_universal_transformer'.
  In file "gs://unifiedqa/models/large/operative_config.gin", line 83
    decoder/make_layer_stack.use_universal_transformer = False
    MODEL_SIZE = "large"
    BASE_PRETRAINED_DIR = "gs://unifiedqa/models/large"
    PRETRAINED_DIR = BASE_PRETRAINED_DIR
    MODEL_DIR = os.path.join(MODEL_DIR, MODEL_SIZE)

    model_parallelism, train_batch_size, keep_checkpoint_max = {
        "small": (1, 256, 16),
        "base": (2, 128, 8),
        "large": (8, 64, 4),
        "3B": (8, 16, 1),
        "11B": (8, 16, 1)}[MODEL_SIZE]
    tf.io.gfile.makedirs(MODEL_DIR)
    ON_CLOUD = False
    model = t5.models.MtfModel(
        model_dir=MODEL_DIR,
        tpu=None,
        model_parallelism=model_parallelism,
        batch_size=train_batch_size,
        sequence_length={"inputs": 128, "targets": 32},
        learning_rate_schedule=0.003,
        save_checkpoints_steps=5000,
        keep_checkpoint_max=keep_checkpoint_max if ON_CLOUD else None,
        iterations_per_loop=100,
    )
    FINETUNE_STEPS = 9

    logInfo("Started Training the model")
    start = time()
    model.finetune(
        mixture_or_task_name="qa_t5_meshs",
        pretrained_model_dir=PRETRAINED_DIR,
        finetune_steps=FINETUNE_STEPS
    )
    logInfo("Completed model training.", time_taken=time() - start)

```How I can fix this?

I have seen one answer in issues, but I don't know what you're trying to say.
@danyaljj
Copy link
Contributor

@ayush714
Copy link
Author

@danyaljj I have seen this so when I use 0.1.12 it give me another errors, and it is not resolving the issue!

@ayush714
Copy link
Author

I tried with most of the versions but still getting the same error!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants