Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bert-serving-start runing——The terminal keeps getting stuck while loading the model. #954

Open
shenshaowei opened this issue Oct 26, 2024 · 0 comments

Comments

@shenshaowei
Copy link

when i run bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
the requirements:
tensorflow:1.15.0
bert-serving-start:1.10.0

(orfd) F:\已做项目\ORFD>bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
2024-10-26 18:37:05.473317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
usage: D:\Anaconda3\envs\orfd\Scripts\bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
                 ARG   VALUE
__________________________________________________
           ckpt_name = bert_model.ckpt
         config_name = bert_config.json
                cors = *
                 cpu = False
          device_map = []
       do_lower_case = True
  fixed_embed_length = False
                fp16 = False
 gpu_memory_fraction = 0.5
       graph_tmp_dir = None
    http_max_connect = 10
           http_port = None
        mask_cls_sep = False
      max_batch_size = 256
         max_seq_len = 25
           model_dir = /ORFD/bert/cased_L-12_H-768_A-12/
no_position_embeddings = False
    no_special_token = False
          num_worker = 2
       pooling_layer = [-2]
    pooling_strategy = REDUCE_MEAN
                port = 5555
            port_out = 5556
       prefetch_size = 10
 priority_batch_size = 16
show_tokens_to_client = False
     tuned_model_dir = None
             verbose = False
                 xla = False

I:�[35mVENTILATOR�[0m:freeze, optimize and export graph, could take a while...
2024-10-26 18:37:13.000498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

I:�[36mGRAPHOPT�[0m:model config: /ORFD/bert/cased_L-12_H-768_A-12/bert_config.json
I:�[36mGRAPHOPT�[0m:checkpoint: /ORFD/bert/cased_L-12_H-768_A-12/bert_model.ckpt

bert-serving-start runing——The terminal keeps getting stuck while loading the model.
how can i solve this bug??Then pressing Ctrl+C doesn't work to exit either.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant