fairseq - how can i use fairseq2 in conda envirionment for using sonar and lcm from meta? - Stack Overflow

admin2025-04-25  2

`I would like to install fairseq2 for using SONAR and LCM(Large Concept Model) from Meta for my personal research interest. I think I just followed the instruction from them(#installing) (#variants). I installed pytorch==2.5.1 and cu118 under python==3.11.11.

I think it should work when I install above version of packages with sonar and sonar-space, but it doesn't work. (Also i installed conda-forge libsndfile==1.0.31)

I could never know what the problem is and how can i solve this shit.

Do you guys know how to solve this issue?

Below message is after i activate the code like this:

from sonar.inference_pipelines.text import TextToEmbeddingModelPipeline
t2vec_model = TextToEmbeddingModelPipeline(encoder="text_sonar_basic_encoder",
                                             tokenizer="text_sonar_basic_encoder")

============================================================================================

{
    "name": "ImportError",
    "message": "cannot import name 'load_nllb_tokenizer' from 'fairseq2.models.nllb' (/home/wvnvwn/.conda/envs/sonar/lib/python3.11/site-packages/fairseq2/models/nllb/__init__.py)",
    "stack": "---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
Cell In[1], line 1
----> 1 from sonar.inference_pipelines.text import TextToEmbeddingModelPipeline
      2 t2vec_model = TextToEmbeddingModelPipeline(encoder=\"text_sonar_basic_encoder\",
      3                                            tokenizer=\"text_sonar_basic_encoder\")
      4 sentences = ['My name is SONAR.', 'I can embed the sentences into vectorial space.']

File ~/.conda/envs/sonar/lib/python3.11/site-packages/sonar/inference_pipelines/__init__.py:7
      1 # Copyright (c) Meta Platforms, Inc. and affiliates.
      2 # All rights reserved.
      3 #
      4 # This source code is licensed under the BSD-style license found in the
      5 # LICENSE file in the root directory of this source tree.
----> 7 from sonar.inference_pipelines.speech import (
      8     SpeechInferenceParams as SpeechInferenceParams,
      9 )
     10 from sonar.inference_pipelines.speech import (
     11     SpeechToEmbeddingPipeline as SpeechToEmbeddingPipeline,
     12 )
     13 from sonar.inference_pipelines.speech import (
     14     SpeechToTextPipeline as SpeechToTextPipeline,
     15 )

File ~/.conda/envs/sonar/lib/python3.11/site-packages/sonar/inference_pipelines/speech.py:27
     25 from sonar.models.sonar_speech.loader import load_sonar_speech_model
     26 from sonar.models.sonar_speech.model import SonarSpeechEncoderModel
---> 27 from sonar.models.sonar_text import load_sonar_text_decoder_model, load_sonar_tokenizer
     28 from sonar.models.sonar_translation.model import SonarEncoderDecoderModel
     29 from sonar.nn.conditional_decoder_model import ConditionalTransformerDecoderModel

File ~/.conda/envs/sonar/lib/python3.11/site-packages/sonar/models/sonar_text/__init__.py:37
     31 from sonar.models.sonar_text.builder import (
     32     sonar_text_encoder_arch as sonar_text_encoder_arch,
     33 )
     34 from sonar.models.sonar_text.builder import (
     35     sonar_text_encoder_archs as sonar_text_encoder_archs,
     36 )
---> 37 from sonar.models.sonar_text.loader import (
     38     load_sonar_text_decoder_config as load_sonar_text_decoder_config,
     39 )
     40 from sonar.models.sonar_text.loader import (
     41     load_sonar_text_decoder_model as load_sonar_text_decoder_model,
     42 )
     43 from sonar.models.sonar_text.loader import (
     44     load_sonar_text_encoder_config as load_sonar_text_encoder_config,
     45 )

File ~/.conda/envs/sonar/lib/python3.11/site-packages/sonar/models/sonar_text/loader.py:12
     10 from fairseq2.models.config_loader import StandardModelConfigLoader
     11 from fairseq2.models.loader import StandardModelLoader, load_model
---> 12 from fairseq2.models.nllb import load_nllb_tokenizer
     13 from fairseq2.models.utils.checkpoint import convert_fairseq_checkpoint
     15 from sonar.models.sonar_text.builder import (
     16     SonarTextDecoderConfig,
     17     SonarTextEncoderConfig,
   (...)
     21     sonar_text_encoder_archs,
     22 )

ImportError: cannot import name 'load_nllb_tokenizer' from 'fairseq2.models.nllb' (/home/wvnvwn/.conda/envs/sonar/lib/python3.11/site-packages/fairseq2/models/nllb/__init__.py)"
}
转载请注明原文地址:http://anycun.com/QandA/1745592057a90930.html