Skip to content

bert-serving-start runing——The terminal keeps getting stuck while loading the model. #954

@shenshaowei

Description

@shenshaowei

when i run bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
the requirements:
tensorflow:1.15.0
bert-serving-start:1.10.0

(orfd) F:\已做项目\ORFD>bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
2024-10-26 18:37:05.473317: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
usage: D:\Anaconda3\envs\orfd\Scripts\bert-serving-start -model_dir /ORFD/bert/cased_L-12_H-768_A-12/ -num_worker=2
                 ARG   VALUE
__________________________________________________
           ckpt_name = bert_model.ckpt
         config_name = bert_config.json
                cors = *
                 cpu = False
          device_map = []
       do_lower_case = True
  fixed_embed_length = False
                fp16 = False
 gpu_memory_fraction = 0.5
       graph_tmp_dir = None
    http_max_connect = 10
           http_port = None
        mask_cls_sep = False
      max_batch_size = 256
         max_seq_len = 25
           model_dir = /ORFD/bert/cased_L-12_H-768_A-12/
no_position_embeddings = False
    no_special_token = False
          num_worker = 2
       pooling_layer = [-2]
    pooling_strategy = REDUCE_MEAN
                port = 5555
            port_out = 5556
       prefetch_size = 10
 priority_batch_size = 16
show_tokens_to_client = False
     tuned_model_dir = None
             verbose = False
                 xla = False

I:�[35mVENTILATOR�[0m:freeze, optimize and export graph, could take a while...
2024-10-26 18:37:13.000498: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library cudart64_100.dll
WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.set_verbosity is deprecated. Please use tf.compat.v1.logging.set_verbosity instead.

WARNING:tensorflow:From D:\Anaconda3\envs\orfd\lib\site-packages\bert_serving\server\helper.py:186: The name tf.logging.ERROR is deprecated. Please use tf.compat.v1.logging.ERROR instead.

I:�[36mGRAPHOPT�[0m:model config: /ORFD/bert/cased_L-12_H-768_A-12/bert_config.json
I:�[36mGRAPHOPT�[0m:checkpoint: /ORFD/bert/cased_L-12_H-768_A-12/bert_model.ckpt

bert-serving-start runing——The terminal keeps getting stuck while loading the model.
how can i solve this bug??Then pressing Ctrl+C doesn't work to exit either.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions