RtcEngine

The basic interface of the Agora SDK that implements the core functions of real-time communication.

RtcEngine provides the main methods that your app can call.

addHandler

Adds event handlers

public void addHandler(IRtcEngineEventHandler handler) {
    mInstance.addHandler(handler);
}

Details

The SDK uses the IRtcEngineEventHandler class to send callbacks to the app. The app inherits the methods of this class to receive these callbacks. All methods in this class have default (empty) implementations. Therefore, apps only need to inherits callbacks according to the scenarios. In the callbacks, avoid time-consuming tasks or calling APIs that can block the thread, such as the sendStreamMessage method. Otherwise, the SDK may not work properly.

Parameters

handler
Callback events to be added. See IRtcEngineEventHandler.

Returns

addExtension

Adds the extension.

public void addExtension(String providerName) {
    mExtensionList.add(providerName);
  }

Parameters

providerName
The name of the extension to add.

addVideoWatermark [1/2]

Adds a watermark image to the local video.

public abstract int addVideoWatermark(AgoraImage watermark);

Details

Deprecated:
This method is deprecated. Use addVideoWatermark [2/2] instead.

This method adds a PNG watermark image to the local video stream in a live streaming session. Once the watermark image is added, all the users in the channel (CDN audience included) and the video capturing device can see and capture it. If you only want to add a watermark to the CDN live streaming, see startRtmpStreamWithTranscoding.

Attention:
  • The URL descriptions are different for the local video and CDN live streaming: In a local video stream, URL refers to the absolute path of the added watermark image file in the local video stream. In a CDN live stream, URL refers to the URL address of the added watermark image in the CDN live streaming.
  • The source file of the watermark image must be in the PNG file format. If the width and height of the PNG file differ from your settings in this method, the PNG file will be cropped to conform to your settings.
  • The Agora SDK supports adding only one watermark image onto a local video or CDN live stream. The newly added watermark image replaces the previous one.

Parameters

watermark
The watermark image to be added to the local live streaming: AgoraImage.

Returns

  • 0: Success.
  • < 0: Failure.

addVideoWatermark [2/2]

Adds a watermark image to the local video.

public abstract int addVideoWatermark(String watermarkUrl, WatermarkOptions options);

Details

This method adds a PNG watermark image to the local video in the live streaming. Once the watermark image is added, all the audience in the channel (CDN audience included), and the capturing device can see and capture it. The Agora SDK supports adding only one watermark image onto a local video or CDN live stream. The newly added watermark image replaces the previous one.

The watermark coordinates are dependent on the settings in the setVideoEncoderConfiguration method:
  • If the orientation mode of the encoding video (ORIENTATION_MODE) is fixed landscape mode or the adaptive landscape mode, the watermark uses the landscape orientation.
  • If the orientation mode of the encoding video (ORIENTATION_MODE) is fixed portrait mode or the adaptive portrait mode, the watermark uses the portrait orientation.
  • When setting the watermark position, the region must be less than the dimensions set in the setVideoEncoderConfiguration method; otherwise, the watermark image will be cropped.
Attention:
  • Ensure that calling this method after enableVideo.
  • If you only want to add a watermark to the media push, you can call this method or the startRtmpStreamWithTranscoding method.
  • This method supports adding a watermark image in the PNG file format only. Supported pixel formats of the PNG image are RGBA, RGB, Palette, Gray, and Alpha_gray.
  • If the dimensions of the PNG image differ from your settings in this method, the image will be cropped or zoomed to conform to your settings.
  • If you have enabled the mirror mode for the local video, the watermark on the local video is also mirrored. To avoid mirroring the watermark, Agora recommends that you do not use the mirror and watermark functions for the local video at the same time. You can implement the watermark function in your application layer.
You can control the visibility of the watermark during preview by setting the visibleInPreview parameter when calling this method. However, whether it ultimately takes effect also depends on the position parameter you set when calling setupLocalVideo (the position of the video frame in the video link). Refer to the table below for details.
Observation position visibleInPreview value Watermark visibility
(Default) VIDEO_MODULE_POSITION_POST_CAPTURER true Yes
false No
VIDEO_MODULE_POSITION_PRE_ENCODER true Yes
false Yes

Parameters

watermarkUrl
The local file path of the watermark image to be added. This method supports adding a watermark image from the local absolute or relative file path.
options
The options of the watermark image to be added. See WatermarkOptions.

Returns

  • 0: Success.
  • < 0: Failure.

adjustAudioMixingPlayoutVolume

Adjusts the volume of audio mixing for local playback.

public abstract int adjustAudioMixingPlayoutVolume(int volume);

Details

Attention: Call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Parameters

volume
The volume of audio mixing for local playback. The value ranges between 0 and 100 (default). 100 represents the original volume.

Returns

  • 0: Success.
  • < 0: Failure.

adjustAudioMixingPublishVolume

Adjusts the volume of audio mixing for publishing.

public abstract int adjustAudioMixingPublishVolume(int volume);

Details

This method adjusts the volume of audio mixing for publishing (sending to other users).

Attention:

Call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Parameters

volume
The volume of audio mixing for local playback. The value ranges between 0 and 100 (default). 100 represents the original volume.

Returns

  • 0: Success.
  • < 0: Failure.

adjustCustomAudioPlayoutVolume

Adjusts the volume of the custom audio track played locally.

public abstract int adjustCustomAudioPlayoutVolume(int trackId, int volume);

Details

Attention: Ensure you have called the createCustomAudioTrack method to create a custom audio track before calling this method.

If you want to change the volume of the audio to be played locally, you need to call this method again.

Parameters

trackId
The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
volume
The volume of the audio source. The value can range from 0 to 100. 0 means mute; 100 means the original volume.

Returns

  • 0: Success.
  • < 0: Failure.

adjustCustomAudioPublishVolume

Adjusts the volume of the custom audio track played remotely.

public abstract int adjustCustomAudioPublishVolume(int trackId, int volume);

Details

Attention: Ensure you have called the createCustomAudioTrack method to create a custom audio track before calling this method.

If you want to change the volume of the audio played remotely, you need to call this method again.

Parameters

trackId
The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
volume
The volume of the audio source. The value can range from 0 to 100. 0 means mute; 100 means the original volume.

Returns

  • 0: Success.
  • < 0: Failure.

adjustAudioMixingVolume

Adjusts the volume during audio mixing.

public abstract int adjustAudioMixingVolume(int volume);

Details

This method adjusts the audio mixing volume on both the local client and remote clients.

Attention:

Parameters

volume
Audio mixing volume. The value ranges between 0 and 100. The default value is 100, which means the original volume.

Returns

  • 0: Success.
  • < 0: Failure.

adjustPlaybackSignalVolume

Adjusts the playback signal volume of all remote users.

public abstract int adjustPlaybackSignalVolume(int volume);

This method is used to adjust the signal volume of all remote users mixed and played locally. If you need to adjust the signal volume of a specified remote user played locally, it is recommended that you call adjustUserPlaybackSignalVolume instead.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

volume
The volume of the user. The value range is [0,400].
  • 0: Mute.
  • 100: (Default) The original volume.
  • 400: Four times the original volume (amplifying the audio signals by four times).

Returns

  • 0: Success.
  • < 0: Failure.

adjustRecordingSignalVolume

Adjusts the capturing signal volume.

public abstract int adjustRecordingSignalVolume(int volume);

If you only need to mute the audio signal, Agora recommends that you use muteRecordingSignal instead.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

volume
The volume of the user. The value range is [0,400].
  • 0: Mute.
  • 100: (Default) The original volume.
  • 400: Four times the original volume (amplifying the audio signals by four times).

Returns

  • 0: Success.
  • < 0: Failure.

adjustUserPlaybackSignalVolume

Adjusts the playback signal volume of a specified remote user.

public abstract int adjustUserPlaybackSignalVolume(int uid, int volume);

You can call this method to adjust the playback volume of a specified remote user. To adjust the playback volume of different remote users, call the method as many times, once for each remote user.

Call timing

Call this method after joining a channel.

Restrictions

None.

Parameters

uid
The user ID of the remote user.
volume
The volume of the user. The value range is [0,400].
  • 0: Mute.
  • 100: (Default) The original volume.
  • 400: Four times the original volume (amplifying the audio signals by four times).

Returns

  • 0: Success.
  • < 0: Failure.

clearVideoWatermarks

Removes the watermark image from the video stream.

public abstract int clearVideoWatermarks();

Returns

  • 0: Success.
  • < 0: Failure.

complain

Allows a user to complain about the call quality after a call ends.

public abstract int complain(String callId, String description);

Details

This method allows users to complain about the quality of the call. Call this method after the user leaves the channel.

Parameters

callId
The current call ID. You can get the call ID by calling getCallId.
description
(Optional) A description of the call. The string length should be less than 800 bytes.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).
    • -2: The parameter is invalid.
    • -7: The method is called before RtcEngine is initialized.

configRhythmPlayer

Configures the virtual metronome.

public abstract int configRhythmPlayer(AgoraRhythmPlayerConfig config);

Details

After calling startRhythmPlayer, you can call this method to reconfigure the virtual metronome.

After successfully calling this method, the SDK triggers the onRhythmPlayerStateChanged callback locally to report the status of the virtual metronome.

Attention:
  • After enabling the virtual metronome, the SDK plays the specified audio effect file from the beginning, and controls the playback duration of each file according to beatsPerMinute you set in AgoraRhythmPlayerConfig. For example, if you set beatsPerMinute as 60, the SDK plays one beat every second. If the file duration exceeds the beat duration, the SDK only plays the audio within the beat duration.
  • By default, the sound of the virtual metronome is published in the channel. If you do not want the sound to be heard by the remote users, you can set publishRhythmPlayerTrack in ChannelMediaOptions as false.

Parameters

config
The metronome configuration. See AgoraRhythmPlayerConfig.

Returns

  • 0: Success.
  • < 0: Failure.

create [1/2]

Creates and initializes RtcEngine.

public static synchronized RtcEngine create(
      Context context, String appId, IRtcEngineEventHandler handler) throws Exception {}

Details

All called methods provided by the RtcEngine class are executed asynchronously. Agora recommends calling these methods in the same thread.

Attention:
  • Before calling other APIs, you must call this method to create the RtcEngine object.
  • You can create the RtcEngine instance either by calling this method or by calling create [2/2]. The difference between create [2/2] and this method is that create [2/2] supports more configurations when creating the RtcEngine instance, for example, specifying the region for connection and setting the log files.
  • The SDK supports creating only one RtcEngine instance for an app.

Parameters

context

The context of Android Activity.

appId
The App ID issued by Agora for your project. Only users in apps with the same App ID can join the same channel and communicate with each other. An App ID can only be used to create one RtcEngine instance. To change your App ID, call destroy to destroy the current RtcEngine instance, and then create a new one.
handler
The event handler for RtcEngine. See IRtcEngineEventHandler.

Returns/Exceptions

  • The RtcEngine instance, if the method call succeeds.
  • The method call fails and an exception is thrown, you need to catch the exception and handle it.

create [2/2]

Creates and initializes RtcEngine.

public static synchronized RtcEngine create(RtcEngineConfig config) throws Exception {}

You can create the RtcEngine instance either by calling this method or by calling create [1/2]. The difference between create [1/2] and this method is that this method supports more configurations when creating the RtcEngine instance, for example, specifying the region for connection and setting the log files.

Attention: All called methods provided by the RtcEngine class are executed asynchronously. Agora recommends calling these methods in the same thread.

Call timing

Before calling other APIs, you must call this method to create the RtcEngine object.

Restrictions

The SDK supports creating only one RtcEngine instance for an app.

Parameters

config

Configurations for the RtcEngine instance. See RtcEngineConfig.

Returns/Exceptions

  • The RtcEngine instance, if the method call succeeds.
  • The method call fails and an exception is thrown, you need to catch the exception and handle it.

createDataStream [1/2]

Creates a data stream.

public abstract int createDataStream(boolean reliable, boolean ordered);

You can call this method to create a data stream and improve the reliability and ordering of data transmission.

Call timing

Call this method after joining a channel.

Restrictions

Each user can create up to five data streams during the lifecycle of RtcEngine. The data stream will be destroyed when leaving the channel, and the data stream needs to be recreated if needed.

Parameters

reliable
Sets whether the recipients are guaranteed to receive the data stream within five seconds:
  • true: The recipients receive the data from the sender within five seconds. If the recipient does not receive the data within five seconds, the SDK triggers the onStreamMessageError callback and returns an error code.
  • false: There is no guarantee that the recipients receive the data stream within five seconds and no error message is reported for any delay or missing data stream.
Attention: Please ensure that reliable and ordered are either both set totrue or both set to false.
ordered
Sets whether the recipients receive the data stream in the sent order:
  • true: The recipients receive the data in the sent order.
  • false: The recipients do not receive the data in the sent order.

Returns

  • ID of the created data stream, if the method call succeeds.
  • < 0: Failure.

createDataStream [2/2]

Creates a data stream.

public abstract int createDataStream(DataStreamConfig config);

Compared to createDataStream [1/2], this method does not guarantee the reliability of data transmission. If a data packet is not received five seconds after it was sent, the SDK directly discards the data.

Call timing

Call this method after joining a channel.

Restrictions

Each user can create up to five data streams during the lifecycle of RtcEngine. The data stream will be destroyed when leaving the channel, and the data stream needs to be recreated if needed.

Parameters

config
The configurations for the data stream. See DataStreamConfig.

Returns

  • ID of the created data stream, if the method call succeeds.
  • < 0: Failure.

createMediaPlayer

Creates a media player instance.

public abstract IMediaPlayer createMediaPlayer();

Returns

  • The IMediaPlayer instance, if the method call succeeds.
  • An empty pointer, if the method call fails.

CreateRendererView

Creates a RendererView.

public static SurfaceView CreateRendererView(Context context) {
    return new SurfaceView(context);

Details

Deprecated:
This method is deprecated. Use the Android native method SurfaceView instead.

This method returns the SurfaceView type. The operation and layout of the view are managed by the app, and the Agora SDK renders the view provided by the app. The video display view must be created using this method instead of directly calling SurfaceView.

To use a SurfaceView, call this method; to use a TextureView, call CreateTextureView.
Attention: Call this in the main thread.

Parameters

context
The context of the Android Activity.

Returns

SurfaceView

CreateTextureView

Creates a TextureView.

public static TextureView CreateTextureView(Context context) {
    return new TextureView(context);

Details

Deprecated:
This method is deprecated. Use the Android native method TextureView instead.

You can call this method to create a TextureView, which is suitable for scenarios that require scaling, rotation, and parallel coordinate translation of video images, such as screen sharing. The operation and layout of the view are managed by the app, and the Agora SDK renders the view provided by the app.

To use a TextureView, call this method; to use a SurfaceView, call CreateRendererView.
Attention: Call this in the main thread.

Parameters

context
The context of the Android Activity.

Returns

TextureView

createCustomVideoTrack

Creates a custom video track.

public abstract int createCustomVideoTrack();

Details

To publish a custom video source, see the following steps:
  1. Call this method to create a video track and get the video track ID.
  2. Call joinChannel [2/2] to join the channel. In ChannelMediaOptions, set customVideoTrackId to the video track ID that you want to publish, and set publishCustomVideoTrack to true.
  3. Call pushExternalVideoFrameById [2/2] and specify videoTrackId as the video track ID set in step 2. You can then publish the corresponding custom video source in the channel.

Returns

  • If the method call is successful, the video track ID is returned as the unique identifier of the video track.
  • If the method call fails, 0xffffffff is returned.

destroyCustomVideoTrack

Destroys the specified video track.

public abstract int destroyCustomVideoTrack(int video_track_id);

Parameters

video_track_id
The video track ID returned by calling the createCustomVideoTrack method.

Returns

  • 0: Success.
  • < 0: Failure.

destroy

Releases the RtcEngine instance.

public static synchronized void destroy() {
                if (mInstance == null)
                return;
                mInstance.doDestroy();
                mInstance = null;
                System.gc();
                }
            

Details

This method releases all resources used by the Agora SDK. Use this method for apps in which users occasionally make voice or video calls. When users do not make calls, you can free up resources for other operations.

After a successful method call, you can no longer use any method or callback in the SDK anymore. If you want to use the real-time communication functions again, you must call create [2/2] to create a new RtcEngine instance.

Attention:
  • This method can be called synchronously. You need to wait for the resource of RtcEngine to be released before performing other operations (for example, create a new RtcEngine object). Therefore, Agora recommends calling this method in the child thread to avoid blocking the main thread.
  • Besides, Agora does not recommend you calling destroy in any callback of the SDK. Otherwise, the SDK cannot release the resources until the callbacks return results, which may result in a deadlock.

disableAudio

Disables the audio module.

public abstract int disableAudio();

The audio module is enabled by default, and you can call this method to disable the audio module.

Call timing

This method can be called either before or after joining the channel. It is still valid after one leaves channel.

Restrictions

This method resets the internal engine and takes some time to take effect. Agora recommends using the following API methods to control the audio modules separately:

Returns

  • 0: Success.
  • < 0: Failure.

disableAudioSpectrumMonitor

Disables audio spectrum monitoring.

public abstract int disableAudioSpectrumMonitor();

Details

After calling enableAudioSpectrumMonitor, if you want to disable audio spectrum monitoring, you can call this method.

Attention:

You can call this method either before or after joining a channel.

Returns

  • 0: Success.
  • < 0: Failure.

disableVideo

Disables the video module.

public abstract int disableVideo();

This method is used to disable the video module.

Call timing

This method can be called either before or after joining the channel.
  • If it is called before joining the channel, the audio-only mode is enabled.
  • If it is called after joining the channel, it switches from video mode to audio-only mode. Then, calling enableVideo can swithch to video mode again.

Restrictions

  • This method affects the internal engine and can be called after leaving the channel.
  • Calling this method will reset the entire engine, resulting in a slow response time. Instead of calling this method, you can independently control a specific video module based on your actual needs using the following methods:

Returns

  • 0: Success.
  • < 0: Failure.

enableAudio

Enables the audio module.

public abstract int enableAudio();

The audio module is enabled by default After calling disableAudio to disable the audio module, you can call this method to re-enable it.

Call timing

This method can be called either before or after joining the channel. It is still valid after one leaves channel.

Restrictions

  • Calling this method will reset the entire engine, resulting in a slow response time. Instead of callling this method, you can independently control a specific audio module based on your actual needs using the following methods:
  • A successful call of this method resets enableLocalAudio, muteRemoteAudioStream, and muteAllRemoteAudioStreams. Proceed it with caution.

Returns

  • 0: Success.
  • < 0: Failure.

enableAudioQualityIndication

Enabled the audio quality notification callback.

public abstract int enableAudioQualityIndication(boolean enabled);

Details

Deprecated:
Deprecated as of v2.4.1.

Parameters

enabled
Whether to enable or disable the audio quality callback.
  • true: Enable the audio quality notification callback.
  • false: (Default) Disable the audio quality notification callback.

Returns

  • 0: Success.
  • < 0: Failure.

enableAudioSpectrumMonitor

Turns on audio spectrum monitoring.

public abstract int enableAudioSpectrumMonitor(int intervalInMS);

Details

If you want to obtain the audio spectrum data of local or remote users, you can register the audio spectrum observer and enable audio spectrum monitoring.

Attention:

You can call this method either before or after joining a channel.

Parameters

intervalInMS

The interval (in milliseconds) at which the SDK triggers the onLocalAudioSpectrum and onRemoteAudioSpectrum callbacks. The default value is 100. Do not set this parameter to a value less than 10, otherwise calling this method would fail.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: Invalid parameters.

enableAudioVolumeIndication

Enables the reporting of users' volume indication.

public abstract int enableAudioVolumeIndication(int interval, int smooth, boolean reportVad);

This method enables the SDK to regularly report the volume information to the app of the local user who sends a stream and remote users (three users at most) whose instantaneous volumes are the highest.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

interval
Sets the time interval between two consecutive volume indications:
  • ≤ 0: Disables the volume indication.
  • > 0: Time interval (ms) between two consecutive volume indications. Ensure this parameter is set to a value greater than 10, otherwise you will not receive the onAudioVolumeIndication callback. Agora recommends that this value is set as greater than 100.
smooth
The smoothing factor that sets the sensitivity of the audio volume indicator. The value ranges between 0 and 10. The recommended value is 3. The greater the value, the more sensitive the indicator.
reportVad
  • true: Enables the voice activity detection of the local user. Once it is enabled, the vad parameter of the onAudioVolumeIndication callback reports the voice activity status of the local user.
  • false: (Default) Disables the voice activity detection of the local user. Once it is disabled, the vad parameter of the onAudioVolumeIndication callback does not report the voice activity status of the local user, except for the scenario where the engine automatically detects the voice activity of the local user.

Returns

  • 0: Success.
  • < 0: Failure.

enableContentInspect

Enables or disables video screenshot and upload.

public abstract int enableContentInspect(boolean enabled, ContentInspectConfig config);

Details

When video screenshot and upload function is enabled, the SDK takes screenshots and uploads videos sent by local users based on the type and frequency of the module you set in ContentInspectConfig. After video screenshot and upload, the Agora server sends the callback notification to your app server in HTTPS requests and sends all screenshots to the third-party cloud storage service.

Note: Before calling this method, ensure that you have contacted technical support to activate the video screenshot upload service.

Parameters

enabled
Whether to enable video screenshot and upload:
  • true: Enables video screenshot and upload.
  • false: Disables video screenshot and upload.
config
Configuration of video screenshot and upload. See ContentInspectConfig.
Note: When the video moderation module is set to video moderation via Agora self-developed extension(CONTENT_INSPECT_TYPE_SUPERVISE), the video screenshot and upload dynamic library agora_content_inspect_extension.so is required. Deleting this library disables the screenshot and upload feature.

Returns

  • 0: Success.
  • < 0: Failure.

enableCustomAudioLocalPlayback

Sets whether to enable the local playback of external audio source.

public abstract int enableCustomAudioLocalPlayback(int trackId, boolean enabled);

Details

Attention: Ensure you have called the createCustomAudioTrack method to create a custom audio track before calling this method.

After calling this method to enable the local playback of external audio source, if you need to stop local playback, you can call this method again and set enabled to false.

You can call adjustCustomAudioPlayoutVolume to adjust the local playback volume of the custom audio track.

Parameters

trackId
The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.
enabled
Whether to play the external audio source:
  • true: Play the external audio source.
  • false: (Default) Do not play the external source.

Returns

  • 0: Success.
  • < 0: Failure.

enableDualStreamMode [1/2]

Enables or disables dual-stream mode on the sender side.

public abstract int enableDualStreamMode(boolean enabled);

Details

Deprecated:
This method is deprecated as of v4.2.0. Use setDualStreamMode [1/2] instead.
Dual streams are a pairing of a high-quality video stream and a low-quality video stream:
  • High-quality video stream: High bitrate, high resolution.
  • Low-quality video stream: Low bitrate, low resolution.

After you enable dual-stream mode, you can call setRemoteVideoStreamType to choose to receive either the high-quality video stream or the low-quality video stream on the subscriber side.

Note:
  • This method is applicable to all types of streams from the sender, including but not limited to video streams collected from cameras, screen sharing streams, and custom-collected video streams.
  • If you need to enable dual video streams in a multi-channel scenario, you can call the enableDualStreamModeEx method.
  • You can call this method either before or after joining a channel.

Parameters

enabled
Whether to enable dual-stream mode:
  • true: Enable dual-stream mode.
  • false: (Default) Disable dual-stream mode.

Returns

  • 0: Success.
  • < 0: Failure.

enableDualStreamMode [2/2]

Sets the dual-stream mode on the sender side and the low-quality video stream.

public abstract int enableDualStreamMode(boolean enabled, SimulcastStreamConfig streamConfig);

Details

Deprecated:
This method is deprecated as of v4.2.0. Use setDualStreamMode [2/2] instead.
You can call this method to enable or disable the dual-stream mode on the publisher side. Dual streams are a pairing of a high-quality video stream and a low-quality video stream:
  • High-quality video stream: High bitrate, high resolution.
  • Low-quality video stream: Low bitrate, low resolution.

After you enable dual-stream mode, you can call setRemoteVideoStreamType to choose to receive either the high-quality video stream or the low-quality video stream on the subscriber side.

Note:
  • This method is applicable to all types of streams from the sender, including but not limited to video streams collected from cameras, screen sharing streams, and custom-collected video streams.
  • If you need to enable dual video streams in a multi-channel scenario, you can call the enableDualStreamModeEx method.
  • You can call this method either before or after joining a channel.

Parameters

enabled
Whether to enable dual-stream mode:
  • true: Enable dual-stream mode.
  • false: (Default) Disable dual-stream mode.
streamConfig
The configuration of the low-quality video stream. See SimulcastStreamConfig.
Note: When setting mode to DISABLE_SIMULCAST_STREAM, setting streamConfig will not take effect.

Returns

  • 0: Success.
  • < 0: Failure.

enableEncryption

Enables or disables the built-in encryption.

public abstract int enableEncryption(boolean enabled, EncryptionConfig config);

Details

In scenarios requiring high security, Agora recommends calling this method to enable the built-in encryption before joining a channel.

All users in the same channel must use the same encryption mode and encryption key. After the user leaves the channel, the SDK automatically disables the built-in encryption. To enable the built-in encryption, call this method before the user joins the channel again.

Attention: If you enable the built-in encryption, you cannot use the Media Push function.

Parameters

enabled
Whether to enable built-in encryption:
  • true: Enable the built-in encryption.
  • false: (Default) Disable the built-in encryption.
config
Built-in encryption configurations. See EncryptionConfig.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: An invalid parameter is used. Set the parameter with a valid value.
    • -4: The built-in encryption mode is incorrect or the SDK fails to load the external encryption library. Check the enumeration or reload the external encryption library.
    • -7: The SDK is not initialized. Initialize the RtcEngine instance before calling this method.

enableExtension

Enables or disables extensions.

public abstract int enableExtension(
      String provider, String extension, boolean enable, Constants.MediaSourceType sourceType);

Call timing

Agora recommends that you call this method after joining a channel.

Restrictions

  • If you want to enable multiple extensions, you need to call this method multiple times.
  • After a successful call of this method, you cannot load other extensions.

Parameters

provider
The name of the extension provider.
extension
The name of the extension.
enable
Whether to enable the extension:
  • true: Enable the extension.
  • false: Disable the extension.
sourceType
Source type of the extension. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.
    • -3: The extension library is not loaded. Agora recommends that you check the storage location or the name of the dynamic library.

enableFaceDetection

Enables or disables face detection for the local user.

public abstract int enableFaceDetection(boolean enabled);

Details

You can call this method either before or after joining a channel.

Once face detection is enabled, the SDK triggers the onFacePositionChanged callback to report the face information of the local user, which includes the following:
  • The width and height of the local video.
  • The position of the human face in the local view.
  • The distance between the human face and the screen.

This method needs to be called after the camera is started (for example, by calling startPreview [2/2] orenableVideo ).

Parameters

enable
Whether to enable face detection for the local user:
  • true: Enable face detection.
  • false: (Default) Disable face detection.

Returns

  • 0: Success.
  • < 0: Failure.

enableInEarMonitoring [1/2]

Enables in-ear monitoring.

public abstract int enableInEarMonitoring(boolean enabled);

This method enables or disables in-ear monitoring.

Call timing

This method can be called either before or after joining the channel.

Restrictions

Users must use earphones (wired or Bluetooth) to hear the in-ear monitoring effect.

Parameters

enabled
Enables or disables in-ear monitoring.
  • true: Enables in-ear monitoring.
  • false: (Default) Disables in-ear monitoring.

Returns

  • 0: Success.
  • < 0: Failure.
    • - 8: Make sure the current audio routing is Bluetooth or headset.

enableInEarMonitoring [2/2]

Enables in-ear monitoring.

public abstract int enableInEarMonitoring(boolean enabled, int includeAudioFilters);

This method enables or disables in-ear monitoring.

Call timing

This method can be called either before or after joining the channel.

Restrictions

Users must use earphones (wired or Bluetooth) to hear the in-ear monitoring effect.

Parameters

enabled
Enables or disables in-ear monitoring.
  • true: Enables in-ear monitoring.
  • false: (Default) Disables in-ear monitoring.
includeAudioFilters
The audio filter types of in-ear monitoring:
  • EAR_MONITORING_FILTER_NONE(1 << 0): No audio filter added to in-ear monitoring.
  • EAR_MONITORING_FILTER_BUILT_IN_AUDIO_FILTERS(1 << 1): Add vocal effects audio filter to in-ear monitoring. If you implement functions such as voice beautifier and audio effect, users can hear the voice after adding these effects. This enumerator supports combination using the bitwise OR operator (|).
  • EAR_MONITORING_FILTER_NOISE_SUPPRESSION(1 << 2): Add noise suppression audio filter to in-ear monitoring. This enumerator supports combination using the bitwise OR operator (|).
  • EAR_MONITORING_FILTER_REUSE_POST_PROCESSING_FILTER(1 <<15): Reuse the audio filter that has been processed on the sending end for in-ear monitoring. This enumerator reduces CPU usage while increasing in-ear monitoring latency, which is suitable for latency-tolerant scenarios requiring low CPU consumption. This enumerator is only supported for standalone use. Once selected, other audio filter configurations will be automatically disabled.
Attention: This parameter only takes effect when enabled is set as true.

Returns

  • 0: Success.
  • < 0: Failure.
    • - 8: Make sure the current audio routing is Bluetooth or headset.

enableInstantMediaRendering

Enables audio and video frame instant rendering.

public abstract int enableInstantMediaRendering();

Details

Since
v4.1.1
After successfully calling this method, the SDK enables the instant frame rendering mode, which can speed up the first frame rendering speed after the user joins the channel.
Attention:
  • Once the instant rendering function is enabled, it can only be canceled by calling the destroy method to destroy the RtcEngine object.
  • In this mode, the SDK uses Agora's custom encryption algorithm to shorten the time required to establish transmission links, and the security is reduced compared to the standard DTLS (Datagram Transport Layer Security). If the application scenario requires higher security standards, Agora recommends that you do not use this method.

Applicable scenarios

Agora recommends that you enable this mode for the audience in a live streaming scenario.

Returns

  • 0: Success.
  • < 0: Failure.
    • -7: The method is called before RtcEngine is initialized.

enableLocalAudio

Enables or disables the local audio capture.

public abstract int enableLocalAudio(boolean enabled);

The audio function is enabled by default when users joining a channel. This method disables or re-enables the local audio function to stop or restart local audio capturing.

The difference between this method and muteLocalAudioStream are as follows:
  • enableLocalAudio: Disables or re-enables the local audio capturing and processing. If you disable or re-enable local audio capturing using the enableLocalAudio method, the local user might hear a pause in the remote audio playback.
  • muteLocalAudioStream: Sends or stops sending the local audio streams without affecting the audio capture status.

Applicable scenarios

This method does not affect receiving the remote audio streams, and enableLocalAudio(false) is applicable to scenarios where the user wants to receive remote audio streams without sending any audio stream to other users in the channel.

Call timing

You can call this method either before or after joining a channel. Calling it before joining a channel only sets the device state, and it takes effect immediately after you join the channel.

Restrictions

None.

Parameters

enabled
  • true: (Default) Re-enable the local audio function, that is, to start the local audio capturing device (for example, the microphone).
  • false: Disable the local audio function, that is, to stop local audio capturing.

Returns

  • 0: Success.
  • < 0: Failure.

enableLocalVideo

Enables/Disables the local video capture.

public abstract int enableLocalVideo(boolean enabled);

Details

This method disables or re-enables the local video capture, and does not affect receiving the remote video stream.

After calling enableVideo, the local video capture is enabled by default.

If you call enableLocalVideo(false) to disable local video capture within the channel, it also simultaneously stops publishing the video stream within the channel. If you want to restart video catpure, you can call enableLocalVideo(true) and then call updateChannelMediaOptions to set the options parameter to publish the locally captured video stream in the channel.

After the local video capturer is successfully disabled or re-enabled, the SDK triggers the onRemoteVideoStateChanged callback on the remote client.

Attention:
  • You can call this method either before or after joining a channel.
  • This method enables the internal engine and is valid after leaving the channel.

Parameters

enabled

Whether to enable the local video capture.

  • true: (Default) Enable the local video capture.
  • false: Disable the local video capture. Once the local video is disabled, the remote users cannot receive the video stream of the local user, while the local user can still receive the video streams of remote users. When set to false, this method does not require a local camera.

Returns

  • 0: Success.
  • < 0: Failure.

enableSoundPositionIndication

Enables or disables stereo panning for remote users.

public abstract int enableSoundPositionIndication(boolean enabled);

Details

Ensure that you call this method before joining a channel to enable stereo panning for remote users so that the local user can track the position of a remote user by calling setRemoteVoicePosition.

Parameters

enabled
Whether to enable stereo panning for remote users:
  • true: Enable stereo panning.
  • false: Disable stereo panning.

Returns

  • 0: Success.
  • < 0: Failure.

enableSpatialAudio

Enables or disables the spatial audio effect.

public abstract int enableSpatialAudio(boolean enabled);

Details

After enabling the spatial audio effect, you can call setRemoteUserSpatialAudioParams to set the spatial audio effect parameters of the remote user.

Note:
  • You can call this method either before or after joining a channel.
  • This method relies on the spatial audio dynamic library libagora_spatial_audio_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable the spatial audio effect:
  • true: Enable the spatial audio effect.
  • false: Disable the spatial audio effect.

Returns

  • 0: Success.
  • < 0: Failure.

enableVideo

Enables the video module.

public abstract int enableVideo();

The video module is disabled by default, call this method to enable it. If you need to disable the video module later, you need to call disableVideo.

Call timing

This method can be called either before joining a channel or while in the channel:
  • If called before joining a channel, it enables the video module.
  • If called during an audio-only call, the audio call automatically switches to a video call.

Restrictions

  • This method enables the internal engine and is valid after leaving the channel.
  • Calling this method will reset the entire engine, resulting in a slow response time. Instead of calling this method, you can independently control a specific video module based on your actual needs using the following methods:
  • A successful call of this method resets enableLocalVideo, muteRemoteVideoStream, and muteAllRemoteVideoStreams. Proceed it with caution.

Returns

  • 0: Success.
  • < 0: Failure.

enableVideoImageSource

Sets whether to replace the current video feeds with images when publishing video streams.

public abstract int enableVideoImageSource(boolean enabled, ImageTrackOptions options);

Details

Attention: Agora recommends that you call this method after joining a channel.

When publishing video streams, you can call this method to replace the current video feeds with custom images.

Once you enable this function, you can select images to replace the video feeds through the ImageTrackOptions parameter. If you disable this function, the remote users see the video feeds that you publish.

Parameters

enable
Whether to replace the current video feeds with custom images:
  • true: Replace the current video feeds with custom images.
  • false: (Default) Do not replace the current video feeds with custom images.
options
Image configurations. See ImageTrackOptions.

Returns

  • 0: Success.
  • < 0: Failure.

enableVirtualBackground [1/2]

Enables/Disables the virtual background.

public abstract int enableVirtualBackground(
      boolean enabled, VirtualBackgroundSource backgroundSource, SegmentationProperty segproperty);

Details

The virtual background feature enables the local user to replace their original background with a static image, dynamic video, blurred background, or portrait-background segmentation to achieve picture-in-picture effect. Once the virtual background feature is enabled, all users in the channel can see the custom background.

Call this method after calling enableVideo or startPreview [2/2].

Attention:
  • This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device. Agora recommends you use virtual background on devices with the following processors:
    • Snapdragon 700 series 750G and later
    • Snapdragon 800 series 835 and later
    • Dimensity 700 series 720 and later
    • Kirin 800 series 810 and later
    • Kirin 900 series 980 and later
  • Agora recommends that you use this feature in scenarios that meet the following conditions:
    • A high-definition camera device is used, and the environment is uniformly lit.
    • There are few objects in the captured video. Portraits are half-length and unobstructed. Ensure that the background is a solid color that is different from the color of the user's clothing.
  • This method relies on the virtual background dynamic library libagora_segmentation_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable virtual background:
  • true: Enable virtual background.
  • false: Disable virtual background.
backgroundSource
The custom background. See VirtualBackgroundSource. To adapt the resolution of the custom background image to that of the video captured by the SDK, the SDK scales and crops the custom background image while ensuring that the content of the custom background image is not distorted.
segproperty
Processing properties for background images. See SegmentationProperty.

Returns

  • 0: Success.
  • < 0: Failure.
    • -4: The device capabilities do not meet the requirements for the virtual background feature. Agora recommends you try it on devices with higher performance.

enableVirtualBackground [2/2]

Enables virtual background and specify the media source, or disables virtual background.

public abstract int enableVirtualBackground(boolean enabled,
      VirtualBackgroundSource backgroundSource, SegmentationProperty segproperty,
      Constants.MediaSourceType sourceType);

Details

The virtual background feature enables the local user to replace their original background with a static image, dynamic video, blurred background, or portrait-background segmentation to achieve picture-in-picture effect. Once the virtual background feature is enabled, all users in the channel can see the custom background.

Both this method and enableVirtualBackground [1/2] enable/disable virtual background, but this method allows you to specify the media source to which the virtual background is applied.

Call this method after calling enableVideo or startPreview [2/2].

Attention:
  • This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device. Agora recommends you use virtual background on devices with the following processors:
    • Snapdragon 700 series 750G and later
    • Snapdragon 800 series 835 and later
    • Dimensity 700 series 720 and later
    • Kirin 800 series 810 and later
    • Kirin 900 series 980 and later
  • Agora recommends that you use this feature in scenarios that meet the following conditions:
    • A high-definition camera device is used, and the environment is uniformly lit.
    • There are few objects in the captured video. Portraits are half-length and unobstructed. Ensure that the background is a solid color that is different from the color of the user's clothing.
  • This method relies on the virtual background dynamic library libagora_segmentation_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable virtual background:
  • true: Enable virtual background.
  • false: Disable virtual background.
backgroundSource
The custom background. See VirtualBackgroundSource. To adapt the resolution of the custom background image to that of the video captured by the SDK, the SDK scales and crops the custom background image while ensuring that the content of the custom background image is not distorted.
segproperty
Processing properties for background images. See SegmentationProperty.
sourceType
The media source type to which the effect is applied. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.
    • -4: The device capabilities do not meet the requirements for the virtual background feature. Agora recommends you try it on devices with higher performance.

enableWebSdkInteroperability

Enables interoperability with the Agora Web SDK (applicable only in the live streaming scenarios).

public abstract int enableWebSdkInteroperability(boolean enabled);

Details

Deprecated:
The SDK automatically enables interoperability with the Web SDK, so you no longer need to call this method.

You can call this method to enable or disable interoperability with the Agora Web SDK. If a channel has Web SDK users, ensure that you call this method, or the video of the Native user will be a black screen for the Web user.

This method is only applicable in live streaming scenarios, and interoperability is enabled by default in communication scenarios.

Parameters

enabled
Whether to enable interoperability:
  • true: Enable interoperability.
  • false: (Default) Disable interoperability.

Returns

  • 0: Success.
  • < 0: Failure.

getAudioDeviceInfo

Gets the audio device information.

public abstract DeviceInfo getAudioDeviceInfo();

Details

After calling this method, you can get whether the audio device supports ultra-low-latency capture and playback.

Attention:
  • You can call this method either before or after joining a channel.

Returns

The DeviceInfo object that identifies the audio device information.
  • Not null: Success.
  • Null: Failure.

getAudioMixingCurrentPosition

Retrieves the playback position (ms) of the music file.

public abstract int getAudioMixingCurrentPosition();

Details

Retrieves the playback position (ms) of the audio.

Attention:
  • You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.
  • If you need to call getAudioMixingCurrentPosition multiple times, ensure that the time interval between calling this method is more than 500 ms.

Returns

  • ≥ 0: The current playback position (ms) of the audio mixing, if this method call succeeds. 0 represents that the current music file does not start playing.
  • < 0: Failure.

getAudioMixingDuration

Retrieves the duration (ms) of the music file.

public abstract int getAudioMixingDuration();

Details

Retrieves the total duration (ms) of the audio.

Attention:

You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Returns

  • ≥ 0: The audio mixing duration, if this method call succeeds.
  • < 0: Failure.

getAudioMixingPlayoutVolume

Retrieves the audio mixing volume for local playback.

public abstract int getAudioMixingPlayoutVolume();

Details

This method helps troubleshoot audio volume‑related issues.

Attention:

You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Returns

  • ≥ 0: The audio mixing volume, if this method call succeeds. The value range is [0,100].
  • < 0: Failure.

getAudioMixingPublishVolume

Retrieves the audio mixing volume for publishing.

public abstract int getAudioMixingPublishVolume();

Details

This method helps troubleshoot audio volume‑related issues.

Attention: You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Returns

  • ≥ 0: The audio mixing volume, if this method call succeeds. The value range is [0,100].
  • < 0: Failure.

getAudioTrackCount

Gets the index of audio tracks of the current music file.

public abstract int getAudioTrackCount();

Details

Note:
  • You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Returns

  • The SDK returns the index of the audio tracks if the method call succeeds.
  • < 0: Failure.

getCallId

Retrieves the call ID.

public abstract String getCallId();

Details

When a user joins a channel on a client, a callId is generated to identify the call from the client. You can call this method to get the callId parameter, and pass it in when calling methods such as rate and complain.

Attention: Call this method after joining a channel.

Returns

The current call ID.

getCameraMaxZoomFactor

Gets the maximum zoom ratio supported by the camera.

public abstract float getCameraMaxZoomFactor();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).

Returns

The maximum zoom factor.

getConnectionState

Gets the current connection state of the SDK.

public abstract RtcConnection.CONNECTION_STATE_TYPE getConnectionState();

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Returns

The current connection state.

getCurrentMonotonicTimeInMs

Gets the current Monotonic Time of the SDK.

public abstract long getCurrentMonotonicTimeInMs();

Details

Since
v4.2.0

Monotonic Time refers to a monotonically increasing time series whose value increases over time. The unit is milliseconds.

In custom video capture and custom audio capture scenarios, in order to ensure audio and video synchronization, Agora recommends that you call this method to obtain the current Monotonic Time of the SDK, and then pass this value into the timestamp parameter in the captured video frame (VideoFrame) and audio frame (AudioFrame).

Returns

  • ≥0: The method call is successful, and returns the current Monotonic Time of the SDK (in milliseconds).
  • < 0: Failure.

getEffectCurrentPosition

Retrieves the playback position of the audio effect file.

public int getEffectCurrentPosition(int soundId);

Details

Attention: Call this method after playEffect [2/2].

Parameters

soundId
The audio effect ID. The ID of each audio effect file is unique.

Returns

  • The playback position (ms) of the specified audio effect file, if the method call succeeds.
  • < 0: Failure.

getEffectDuration

Retrieves the duration of the audio effect file.

public abstract int getEffectDuration(String filePath);

Details

Attention: Call this method after joining a channel.

Parameters

filePath
File path:
  • Android: The file path, which needs to be accurate to the file name and suffix. Agora supports URL addresses, absolute paths, or file paths that start with /assets/. You might encounter permission issues if you use an absolute path to access a local file, so Agora recommends using a URI address instead. For example: content://com.android.providers.media.documents/document/audio%3A14441

Returns

  • The total duration (ms) of the specified audio effect file, if the method call succeeds.
  • < 0: Failure.

getErrorDescription

Gets the warning or error description.

public static String getErrorDescription(int error)

Parameters

error
The error code or warning code reported by the SDK.

Returns

The specific error or warning description.

getExtensionProperty [1/2]

Gets detailed information on the extensions.

public abstract String getExtensionProperty(String provider, String extension, String key);

Details

Parameters

provider
The name of the extension provider.
extension
The name of the extension.
key
The key of the extension.

Returns

  • The extension information, if the method call succeeds.
  • An empty string, if the method call fails.

getExtensionProperty [2/2]

Gets detailed information on the extensions.

public abstract String getExtensionProperty(
      String provider, String extension, String key, Constants.MediaSourceType sourceType);

Details

Parameters

provider
The name of the extension provider.
extension
The name of the extension.
key
The key of the extension.
sourceType
Source type of the extension. See MediaSourceType.

Returns

  • The extension information, if the method call succeeds.
  • An empty string, if the method call fails.

getMediaPlayerCacheManager

Gets one IMediaPlayerCacheManager instance.

public abstract IMediaPlayerCacheManager getMediaPlayerCacheManager();

Details

When you successfully call this method, the SDK returns a media player cache manager instance. The cache manager is a singleton pattern. Therefore, multiple calls to this method returns the same instance.

Attention:

Make sure the RtcEngine is initialized before you call this method.

Returns

The IMediaPlayerCacheManager instance.

getNativeHandle

Gets the C++ handle of the Native SDK.

public abstract long getNativeHandle();

Details

This method retrieves the C++ handle of the SDK, which is used for registering the audio and video frame observer.

Returns

The native handle of the SDK.

getNetworkType

Gets the type of the local network connection.

public abstract int getNetworkType();

Details

Since
v4.0.1

You can use this method to get the type of network in use at any stage.

Note: You can call this method either before or after joining a channel.

Returns

  • ≥ 0: The method call is successful, and the local network connection type is returned.
    • 0: The SDK disconnects from the network.
    • 1: The network type is LAN.
    • 2: The network type is Wi-Fi (including hotspots).
    • 3: The network type is mobile 2G.
    • 4: The network type is mobile 3G.
    • 5: The network type is mobile 4G.
    • 6: The network type is mobile 5G.
  • < 0: The method call failed with an error code.
    • -1: The network type is unknown.

getUserInfoByUid

Gets the user information by passing in the user ID.

public abstract int getUserInfoByUid(int uid, UserInfo userInfo);

After a remote user joins the channel, the SDK gets the UID and user account of the remote user, caches them in a mapping table object, and triggers the onUserInfoUpdated callback on the local client. After receiving the callback, you can call this method and passi in the UID.to get the user account of the specified user from the UserInfo object.

Call timing

Call this method after receiving the onUserInfoUpdated callback.

Restrictions

None.

Parameters

uid
The user ID.
userInfo
Input and output parameter. The UserInfo object that identifies the user information.
  • Input value: A UserInfo object.
  • Output: A UserInfo object that contains both the user account and UID.

Returns

  • 0: Success.
  • < 0: Failure.

getUserInfoByUserAccount

Gets the user information by passing in the user account.

public abstract int getUserInfoByUserAccount(String userAccount, UserInfo userInfo);

After a remote user joins the channel, the SDK gets the UID and user account of the remote user, caches them in a mapping table object, and triggers the onUserInfoUpdated callback on the local client. After receiving the callback, you can call this method and pass in the user account to get the UID of the remote user from the UserInfo object.

Call timing

Call this method after receiving the onUserInfoUpdated callback.

Restrictions

None.

Parameters

userAccount
The user account.
userInfo
Input and output parameter. The UserInfo object that identifies the user information.
  • Input value: A UserInfo object.
  • Output: A UserInfo object that contains both the user account and UID.

Returns

  • 0: Success.
  • < 0: Failure.

getSdkVersion

Gets the SDK version.

public static String getSdkVersion()

Parameters

Returns

The SDK version number. The format is a string.

isCameraAutoFocusFaceModeSupported

Checks whether the device supports the face auto-focus function.

public abstract boolean isCameraAutoFocusFaceModeSupported();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).

Returns

  • true: The device supports the face auto-focus function.
  • false: The device does not support the face auto-focus function.

isCameraExposurePositionSupported

Checks whether the device supports manual exposure.

public abstract boolean isCameraExposurePositionSupported();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).

Returns

  • true: The device supports manual exposure.
  • false: The device does not support manual exposure.

isCameraExposureSupported

Queries whether the current camera supports adjusting exposure value.

public abstract boolean isCameraExposureSupported();

Details

Since
v4.2.2
Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).
  • Before calling setCameraExposureFactor, Agora recoomends that you call this method to query whether the current camera supports adjusting the exposure value.
  • By calling this method, you adjust the exposure value of the currently active camera, that is, the camera specified when calling setCameraCapturerConfiguration.

Returns

  • true: Success.
  • false: Failure.

isCameraFaceDetectSupported

Checks whether the device camera supports face detection.

public abstract boolean isCameraFaceDetectSupported();

Returns

  • true: The device camera supports face detection.
  • false: The device camera does not support face detection.

isCameraFocusSupported

Check whether the device supports the manual focus function.

public abstract boolean isCameraFocusSupported();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).

Returns

  • true: The device supports the manual focus function.
  • false: The device does not support the manual focus function.

isCameraTorchSupported

Checks whether the device supports camera flash.

public abstract boolean isCameraTorchSupported();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).
  • The app enables the front camera by default. If your front camera does not support flash, this method returns false. If you want to check whether the rear camera supports the flash function, call switchCamera [1/2] before this method.

Returns

  • true: The device supports camera flash.
  • false: The device does not support camera flash.

isCameraZoomSupported

Checks whether the device supports camera zoom.

public abstract boolean isCameraZoomSupported();

Details

Attention:
  • This method must be called after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_ENCODING (2).

Returns

  • true: The device supports camera zoom.
  • false: The device does not support camera zoom.

isFeatureAvailableOnDevice

Checks whether the device supports the specified advanced feature.

public abstract boolean isFeatureAvailableOnDevice(int type);

Details

Since
v4.2.3

Checks whether the capabilities of the current device meet the requirements for advanced features such as virtual background and image enhancement.

Applicable scenarios

Before using advanced features, you can check whether the current device supports these features based on the call result. This helps to avoid performance degradation or unavailable features when enabling advanced features on low-end devices. Based on the return value of this method, you can decide whether to display or enable the corresponding feature button, or notify the user when the device's capabilities are insufficient.

Parameters

type
The type of the advanced feature.
  • VIDEO_VIRTUAL_BACKGROUND(1): Virutual background.
  • VIDEO_BEAUTY_EFFECT(2): Image enhancement.

Returns

  • true: The current device supports the specified feature.
  • false: The current device does not support the specified feature.

isSpeakerphoneEnabled

Checks whether the speakerphone is enabled.

public abstract boolean isSpeakerphoneEnabled();

Returns

  • true: The speakerphone is enabled, and the audio plays from the speakerphone.
  • false: The speakerphone is not enabled, and the audio plays from devices other than the speakerphone. For example, the headset or earpiece.

isTextureEncodeSupported

Check whether the video supports the Texture encoding.

public abstract boolean isTextureEncodeSupported();

Returns

  • true: Supports the Texture encoding.
  • false: Does not support the Texture encoding.

joinChannel [1/2]

Joins a channel.

public abstract int joinChannel(
    String token, String channelId, String optionalInfo, int uid);

Details

This method enables users to join a channel. Users in the same channel can talk to each other, and multiple users in the same channel can start a group chat. Users with different App IDs cannot call each other.

A successful call of this method triggers the following callbacks:

When the connection between the client and Agora's server is interrupted due to poor network conditions, the SDK tries reconnecting to the server. When the local client successfully rejoins the channel, the SDK triggers the onRejoinChannelSuccess callback on the local client.

Attention:
  • Once a user joins the channel, the user subscribes to the audio and video streams of all the other users in the channel by default, giving rise to usage and billing calculation. To stop subscribing to a specified stream or all remote streams, call the corresponding mute methods.
  • If you choose the Testing Mode (using an App ID for authentication) for your project and call this method to join a channel, you will automatically exit the channel after 24 hours.

Parameters

token
The token generated on your server for authentication. See .
Note: If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
channelId
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
  • All lowercase English letters: a to z.
  • All uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
optionalInfo
(Optional) Reserved for future use.
uid
The user ID. This parameter is used to identify the user in the channel for real-time audio and video interaction. You need to set and manage user IDs yourself, and ensure that each user ID in the same channel is unique. This parameter is a 32-bit signed integer. The value range is from -231-1 to 231-1. If the user ID is not assigned (or set to 0), the SDK assigns a random user ID and onJoinChannelSuccess returns it in the callback. Your application must record and maintain the returned user ID, because the SDK does not do so.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
    • -3: Failes to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
    • -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
    • -8: The internal state of the RtcEngine object is wrong. The typical cause is that you call this method to join the channel without calling startEchoTest [3/3] to stop the test after calling stopEchoTest to start a call loop test. You need to call stopEchoTest before calling this method.
    • -17: The request to join the channel is rejected. The typical cause is that the user is in the channel. Agora recommends that you use the onConnectionStateChanged callback to determine whether the user exists in the channel. Do not call this method to join the channel unless you receive the CONNECTION_STATE_DISCONNECTED(1) state.
    • -102: The channel name is invalid. You need to pass in a valid channelname in channelId to rejoin the channel.
    • -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.

joinChannel [2/2]

Joins a channel with media options.

public abstract int joinChannel(
      String token, String channelId, int uid, ChannelMediaOptions options);

Details

This method enables users to join a channel. Users in the same channel can talk to each other, and multiple users in the same channel can start a group chat. Users with different App IDs cannot call each other.

A successful call of this method triggers the following callbacks:

When the connection between the client and Agora's server is interrupted due to poor network conditions, the SDK tries reconnecting to the server. When the local client successfully rejoins the channel, the SDK triggers the onRejoinChannelSuccess callback on the local client.

Compared to joinChannel [1/2], this method adds the options parameter to configure whether to automatically subscribe to all remote audio and video streams in the channel when the user joins the channel. By default, the user subscribes to the audio and video streams of all the other users in the channel, giving rise to usage and billings. To unsubscribe, set the options parameter or call the mute methods accordingly.

Attention:
  • This method allows users to join only one channel at a time.
  • Ensure that the app ID you use to generate the token is the same app ID that you pass in the create [2/2] method; otherwise, you may fail to join the channel by token.
  • If you choose the Testing Mode (using an App ID for authentication) for your project and call this method to join a channel, you will automatically exit the channel after 24 hours.

Parameters

token
The token generated on your server for authentication. See .
Note: If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
channelId
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
  • All lowercase English letters: a to z.
  • All uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
uid
The user ID. This parameter is used to identify the user in the channel for real-time audio and video interaction. You need to set and manage user IDs yourself, and ensure that each user ID in the same channel is unique. This parameter is a 32-bit signed integer. The value range is from -231-1 to 231-1. If the user ID is not assigned (or set to 0), the SDK assigns a random user ID and onJoinChannelSuccess returns it in the callback. Your application must record and maintain the returned user ID, because the SDK does not do so.
options
The channel media options. See ChannelMediaOptions.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
    • -3: Failes to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
    • -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
    • -8: The internal state of the RtcEngine object is wrong. The typical cause is that you call this method to join the channel without calling startEchoTest [3/3] to stop the test after calling stopEchoTest to start a call loop test. You need to call stopEchoTest before calling this method.
    • -17: The request to join the channel is rejected. The typical cause is that the user is in the channel. Agora recommends that you use the onConnectionStateChanged callback to determine whether the user exists in the channel. Do not call this method to join the channel unless you receive the CONNECTION_STATE_DISCONNECTED(1) state.
    • -102: The channel name is invalid. You need to pass in a valid channelname in channelId to rejoin the channel.
    • -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.

joinChannelWithUserAccount [1/2]

Joins a channel with a User Account and Token.

public abstract int joinChannelWithUserAccount(
                    String token, String channelName, String userAccount);

Details

This method allows a user to join the channel with the user account and a token. After the user successfully joins the channel, the SDK triggers the following callbacks:

Once a user joins the channel, the user subscribes to the audio and video streams of all the other users in the channel by default, giving rise to usage and billing calculation. To stop subscribing to a specified stream or all remote streams, call the corresponding mute methods.

Attention:
  • To ensure smooth communication, use the same parameter type to identify the user. For example, if a user joins the channel with a user ID, then ensure all the other users use the user ID too. The same applies to the user account. If a user joins the channel with the Agora Web SDK, ensure that the ID of the user is set to the same parameter type.
  • If you choose the Testing Mode (using an App ID for authentication) for your project and call this method to join a channel, you will automatically exit the channel after 24 hours.

Parameters

token
The token generated on your server for authentication. See .
Note: If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
channelName
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
  • All lowercase English letters: a to z.
  • All uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
userAccount
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follows(89 in total):
  • The 26 lowercase English letters: a to z.
  • The 26 uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • Space
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid.
    • -3: The initialization of the SDK fails. You can try to initialize the SDK again.
    • -5: The request is rejected.
    • -17: The request to join the channel is rejected. Since the SDK only supports users to join one RtcEngine channel at a time; this error code will be returned when the user who has joined the RtcEngine channel calls the join channel method in the RtcEngine class again with a valid channel name.

joinChannelWithUserAccount [2/2]

Joins the channel with a user account, and configures whether to automatically subscribe to audio or video streams after joining the channel.

public abstract int joinChannelWithUserAccount(
                    String token, String channelName, String userAccount, ChannelMediaOptions options);

Details

This method allows a user to join the channel with the user account. After the user successfully joins the channel, the SDK triggers the following callbacks:

Once a user joins the channel, the user subscribes to the audio and video streams of all the other users in the channel by default, giving rise to usage and billing calculation. To stop subscribing to a specified stream or all remote streams, call the corresponding mute methods.

Compared to joinChannelWithUserAccount [1/2], this method adds the options parameter to configure whether to automatically subscribe to all remote audio and video streams in the channel when the user joins the channel. By default, the user subscribes to the audio and video streams of all the other users in the channel, giving rise to usage and billings. To unsubscribe, set the options parameter or call the mute methods accordingly.

Attention:
  • To ensure smooth communication, use the same parameter type to identify the user. For example, if a user joins the channel with a user ID, then ensure all the other users use the user ID too. The same applies to the user account. If a user joins the channel with the Agora Web SDK, ensure that the ID of the user is set to the same parameter type.
  • If you choose the Testing Mode (using an App ID for authentication) for your project and call this method to join a channel, you will automatically exit the channel after 24 hours.

Parameters

token
The token generated on your server for authentication. See .
Note: If you need to join different channels at the same time or switch between channels, Agora recommends using a wildcard token so that you don't need to apply for a new token every time joining a channel. See Secure authentication with tokens.
channelName
The channel name. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
  • All lowercase English letters: a to z.
  • All uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
userAccount
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follows(89 in total):
  • The 26 lowercase English letters: a to z.
  • The 26 uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • Space
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
options
The channel media options. See ChannelMediaOptions.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid. For example, the token is invalid, the uid parameter is not set to an integer, or the value of a member in ChannelMediaOptions is invalid. You need to pass in a valid parameter and join the channel again.
    • -3: Failes to initialize the RtcEngine object. You need to reinitialize the RtcEngine object.
    • -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
    • -8: The internal state of the RtcEngine object is wrong. The typical cause is that you call this method to join the channel without calling startEchoTest [3/3] to stop the test after calling stopEchoTest to start a call loop test. You need to call stopEchoTest before calling this method.
    • -17: The request to join the channel is rejected. The typical cause is that the user is in the channel. Agora recommends that you use the onConnectionStateChanged callback to determine whether the user exists in the channel. Do not call this method to join the channel unless you receive the CONNECTION_STATE_DISCONNECTED(1) state.
    • -102: The channel name is invalid. You need to pass in a valid channelname in channelId to rejoin the channel.
    • -121: The user ID is invalid. You need to pass in a valid user ID in uid to rejoin the channel.

leaveChannel [1/2]

Leaves a channel.

public abstract int leaveChannel();

After calling this method, the SDK terminates the audio and video interaction, leaves the current channel, and releases all resources related to the session.

After joining the channel, you must call this method to end the call; otherwise, the next call cannot be started.

Attention:
  • This method call is asynchronous. When this method returns, it does not necessarily mean that the user has left the channel.
  • If you have called joinChannelEx to join multiple channels, calling this method will leave all the channels you joined.

Call timing

Call this method after joining a channel.

Restrictions

If you call destroy immediately after calling this method, the SDK does not trigger the onLeaveChannel callback.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).
    • -2: The parameter is invalid.
    • -7: The SDK is not initialized.

leaveChannel [2/2]

Sets channel options and leaves the channel.

public abstract int leaveChannel(LeaveChannelOptions options);

After calling this method, the SDK terminates the audio and video interaction, leaves the current channel, and releases all resources related to the session.

After joining a channel, you must call this method or leaveChannel [1/2] to end the call, otherwise, the next call cannot be started. If you have called joinChannelEx to join multiple channels, calling this method will leave all the channels you joined.

Attention: This method call is asynchronous. When this method returns, it does not necessarily mean that the user has left the channel.

Call timing

Call this method after joining a channel.

Restrictions

If you call destroy immediately after calling this method, the SDK does not trigger the onLeaveChannel callback.

Parameters

options
The options for leaving the channel. See LeaveChannelOptions.

Returns

  • 0: Success.
  • < 0: Failure.

muteAllRemoteAudioStreams

Stops or resumes subscribing to the audio streams of all remote users.

public abstract int muteAllRemoteAudioStreams(boolean muted);

After successfully calling this method, the local user stops or resumes subscribing to the audio streams of all remote users, including all subsequent users.

Attention:

By default, the SDK subscribes to the audio streams of all remote users when joining a channel. To modify this behavior, you can set autoSubscribeAudio to false when calling joinChannel [2/2] to join the channel, which will cancel the subscription to the audio streams of all users upon joining the channel.

Call timing

Call this method after joining a channel.

Restrictions

If you call this method and then call enableAudio or disableAudio, the latest call will prevail.

Parameters

muted
Whether to stop subscribing to the audio streams of all remote users:
  • true: Stops subscribing to the audio streams of all remote users.
  • false: (Default) Subscribes to the audio streams of all remote users by default.

Returns

  • 0: Success.
  • < 0: Failure.

muteAllRemoteVideoStreams

Stops or resumes subscribing to the video streams of all remote users.

public abstract int muteAllRemoteVideoStreams(boolean muted);

After successfully calling this method, the local user stops or resumes subscribing to the video streams of all remote users, including all subsequent users.

Attention:

By default, the SDK subscribes to the video streams of all remote users when joining a channel. To modify this behavior, you can set autoSubscribeVideo tofalse when calling joinChannel [2/2] to join the channel, which will cancel the subscription to the video streams of all users upon joining the channel.

Call timing

Call this method after joining a channel.

Restrictions

If you call this method and then call enableVideo or disableVideo, the latest call will prevail.

Parameters

muted
Whether to stop subscribing to the video streams of all remote users.
  • true: Stop subscribing to the video streams of all remote users.
  • false: (Default) Subscribe to the video streams of all remote users by default.

Returns

  • 0: Success.
  • < 0: Failure.

muteLocalAudioStream

Stops or resumes publishing the local audio stream.

public abstract int muteLocalAudioStream(boolean muted);

This method is used to control whether to publish the locally captured audio stream. If you call this method to stop publishing locally captured audio streams, the audio capturing device will still work and won't be affected.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

muted
Whether to stop publishing the local audio stream:
  • true: Stops publishing the local audio stream.
  • false: (Default) Resumes publishing the local audio stream.

Returns

  • 0: Success.
  • < 0: Failure.

muteLocalVideoStream

Stops or resumes publishing the local video stream.

public abstract int muteLocalVideoStream(boolean muted);

This method is used to control whether to publish the locally captured video stream. If you call this method to stop publishing locally captured video streams, the video capturing device will still work and won't be affected.

Compared to enableLocalVideo(false), which can also cancel the publishing of local video stream by turning off the local video stream capture, this method responds faster.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

muted
Whether to stop publishing the local video stream.
  • true: Stop publishing the local video stream.
  • false: (Default) Publish the local video stream.

Returns

  • 0: Success.
  • < 0: Failure.

muteRecordingSignal

Whether to mute the recording signal.

public abstract int muteRecordingSignal(boolean muted);
If you have already called adjustRecordingSignalVolume to adjust the recording signal volume, when you call this method and set it to true, the SDK behaves as follows:
  1. Records the adjusted volume.
  2. Mutes the recording signal.
When you call this method again and set it to false, the recording signal volume will be restored to the volume recorded by the SDK before muting.

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

muted
  • true: Mute the recording signal.
  • false: (Default) Do not mute the recording signal.

Returns

  • 0: Success.
  • < 0: Failure.

muteRemoteAudioStream

Stops or resumes subscribing to the audio stream of a specified user.

public abstract int muteRemoteAudioStream(int uid, boolean muted);

Call timing

Call this method after joining a channel.

Restrictions

None.

Parameters

uid
The user ID of the specified user.
muted
Whether to subscribe to the specified remote user's audio stream.
  • true: Stop subscribing to the audio stream of the specified user.
  • false: (Default) Subscribe to the audio stream of the specified user.

Returns

  • 0: Success.
  • < 0: Failure.

muteRemoteVideoStream

Stops or resumes subscribing to the video stream of a specified user.

public abstract int muteRemoteVideoStream(int userId, boolean muted);

Call timing

Call this method after joining a channel.

Restrictions

None.

Parameters

userId
The user ID of the specified user.
muted
Whether to subscribe to the specified remote user's video stream.
  • true: Stop subscribing to the video streams of the specified user.
  • false: (Default) Subscribe to the video stream of the specified user.

Returns

  • 0: Success.
  • < 0: Failure.

onVideoRenderingTracingResult

Video frame rendering event callback.

public void onVideoRenderingTracingResult(int uid,
    Constants.MEDIA_RENDER_TRACE_EVENT currentEvent, VideoRenderingTracingInfo tracingInfo) {}
Since
v4.1.1

After calling the startMediaRenderingTracing method or joining the channel, the SDK triggers this callback to report the events of video frame rendering and the indicators during the rendering process. Developers can optimize the indicators to improve the efficiency of the first video frame rendering.

Parameters

uid
The user ID.
currentEvent
The current video frame rendering event. See MEDIA_TRACE_EVENT.
tracingInfo
The indicators during the video frame rendering process. Developers need to reduce the value of indicators as much as possible in order to improve the efficiency of the first video frame rendering. See VideoRenderingTracingInfo.

pauseAllChannelMediaRelay

Pauses the media stream relay to all target channels.

public abstract int pauseAllChannelMediaRelay();

Details

After the cross-channel media stream relay starts, you can call this method to pause relaying media streams to all target channels; after the pause, if you want to resume the relay, call resumeAllChannelMediaRelay.

Attention: Call this method after startOrUpdateChannelMediaRelay.

Returns

  • 0: Success.
  • < 0: Failure.

pauseAudioMixing

Pauses playing and mixing the music file.

public abstract int pauseAudioMixing();

Details

Call this method after joining a channel.

Returns

  • 0: Success.
  • < 0: Failure.

preloadChannel

Preloads a channel with token, channelName, and optionalUid.

public abstract int preloadChannel(String token, String channelName, int optionalUid);
Since
v4.2.2

When audience members need to switch between different channels frequently, calling the method can help shortening the time of joining a channel, thus reducing the time it takes for audience members to hear and see the host.

If you join a preloaded channel, leave it and want to rejoin the same channel, you do not need to call this method unless the token for preloading the channel expires.

Note: Failing to preload a channel does not mean that you can't join a channel, nor will it increase the time of joining a channel.

Call timing

To improve the user experience of preloading channels, Agora recommends that before joining the channel, calling this method as early as possible once confirming the channel name and user information.

Restrictions

  • When calling this method, ensure you set the user role as audience and do not set the audio scenario as AUDIO_SCENARIO_CHORUS, otherwise, this method does not take effect.
  • You also need to make sure that the channel name, user ID and token passed in for preloading are the same as the values passed in when joinning the channel, otherwise, this method does not take effect.
  • One RtcEngine instance supports preloading 20 channels at most. When exceeding this limit, the latest 20 preloaded channels take effect.

Parameters

token
The token generated on your server for authentication. See .
When the token for preloading channels expires, you can update the token based on the number of channels you preload.
  • When preloading one channel, calling this method to pass in the new token.
  • When preloading more than one channels:
    • If you use a wildcard token for all preloaded channels, call updatePreloadChannelToken to update the token.
      Note: When generating a wildcard token, ensure the user ID is not set as 0. See Secure authentication with tokens.
    • If you use different tokens to preload different channels, call this method to pass in your user ID, channel name and the new token.
channelName
The channel name that you want to preload. This parameter signifies the channel in which users engage in real-time audio and video interaction. Under the premise of the same App ID, users who fill in the same channel ID enter the same channel for audio and video interaction. The string length must be less than 64 bytes. Supported characters (89 characters in total):
  • All lowercase English letters: a to z.
  • All uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","
uid
The user ID. This parameter is used to identify the user in the channel for real-time audio and video interaction. You need to set and manage user IDs yourself, and ensure that each user ID in the same channel is unique. This parameter is a 32-bit signed integer. The value range is from -231-1 to 231-1. If the user ID is not assigned (or set to 0), the SDK assigns a random user ID and onJoinChannelSuccess returns it in the callback. Your application must record and maintain the returned user ID, because the SDK does not do so.

Returns

  • 0: Success.
  • < 0: Failure.
    • -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
    • -102: The channel name is invalid. You need to pass in a valid channel name and join the channel again.

pullPlaybackAudioFrame [1/2]

Pulls the remote audio data.

public abstract int pullPlaybackAudioFrame(byte[] data, int lengthInByte);

Details

Before calling this method, call setExternalAudioSink(enabled: true) to notify the app to enable and set the external audio rendering.

After a successful call of this method, the app pulls the decoded and mixed audio data for playback.

Attention:
  • Call this method after joining a channel.
  • Both this method and onPlaybackAudioFrame callback can be used to get audio data after remote mixing. Note that after calling setExternalAudioSink to enable external audio rendering, the app no longer receives data from the onPlaybackAudioFrame callback. Therefore, you should choose between this method and the onPlaybackAudioFrame callback based on your actual business requirements. The specific distinctions between them are as follows:
    • After calling this method, the app automatically pulls the audio data from the SDK. By setting the audio data parameters, the SDK adjusts the frame buffer to help the app handle latency, effectively avoiding audio playback jitter.
    • The SDK sends the audio data to the app through the onPlaybackAudioFrame callback. Any delay in processing the audio frames may result in audio jitter.
  • This method is only used for retrieving audio data after remote mixing. If you need to get audio data from different audio processing stages such as capture and playback, you can register the corresponding callbacks by calling registerAudioFrameObserver.

Parameters

data
The remote audio data to be pulled. The data type is byte[].
lengthInByte
The data length (byte). The value of this parameter is related to the audio duration, and the values of the sampleRate and channels parameters that you set in setExternalAudioSink. lengthInByte = sampleRate/1000 × 2 × channels × audio duration (ms).

Returns

  • 0: Success.
  • < 0: Failure.

pullPlaybackAudioFrame [2/2]

Pulls the remote audio data.

public abstract int pullPlaybackAudioFrame(ByteBuffer data, int lengthInByte);

Details

Before calling this method, call the setExternalAudioSink(enabled: true) method to notify the app to enable and set the external audio sink.

After a successful method call, the app pulls the decoded and mixed audio data for playback.

Attention:
  • Call this method after joining a channel.
  • The difference between this method and the onPlaybackAudioFrame callback is as follows:
    • onPlaybackAudioFrame: The SDK sends the audio data to the app through this callback. Any delay in processing the audio frames may result in audio jitter.
    • pullPlaybackAudioFrame [1/2]: The app pulls the remote audio data. After setting the audio data parameters, the SDK adjusts the frame buffer and avoids problems caused by jitter in the external audio playback.

Parameters

data
The remote audio data to be pulled. The data type is ByteBuffer.
lengthInByte
The length (in bytes) of the remote audio data. The value of this parameter is related to the audio duration,and the values of the sampleRate and channels parameters that you set in setExternalAudioSink. lengthInByte = sampleRate/1000 × 2 × channels × audio duration (ms).

Returns

  • 0: Success.
  • < 0: Failure.

pushExternalAudioFrame

Pushes the external audio frame to the SDK.

public abstract int pushExternalAudioFrame(byte[] data, long timestamp, int sampleRate,
      int channels, Constants.BytesPerSample bytesPerSample, int trackId);

Details

Attention:
Before calling this method to push external audio data, perform the following steps:
  1. Call createCustomAudioTrack to create a custom audio track and get the audio track ID.
  2. Call joinChannel [2/2] to join the channel. In ChannelMediaOptions, set publishCustomAudioTrackId to the audio track ID that you want to publish, and set publishCustomAudioTrack to true.

Parameters

data
The external audio data.
timestamp
The timestamp (ms) of the external audio frame. This parameter is required. You can use it to restore the order of the captured audio frames, or synchronize audio and video frames in video-related scenarios (including scenarios where external video sources are used).
sampleRate
The sample rate (Hz) of the external audio source, which can be set as 8000, 16000, 32000, 44100, or 48000.
channels
The number of audio channels of the external audio sink:
  • 1: Mono.
  • 2: Stereo.
bytesPerSample
The number of bytes per sample. For PCM, this parameter is generally set to 16 bits (2 bytes).
trackId
The audio track ID. Set this parameter to the custom audio track ID returned in createCustomAudioTrack.

Returns

  • 0: Success.
  • < 0: Failure.

pushExternalVideoFrameById [1/2]

Pushes the external raw video frame to the SDK through video tracks.

public abstract int pushExternalVideoFrameById(AgoraVideoFrame frame, int videoTrackId);

Details

Deprecated:
If you need to push video frames in I422 format, you need to use this method; otherwise, use pushExternalVideoFrameById [2/2].
To publish a custom video source, see the following steps:
  1. Call createCustomVideoTrack to create a video track and get the video track ID.
  2. Call joinChannel [2/2] to join the channel. In ChannelMediaOptions, set customVideoTrackId to the video track ID that you want to publish, and set publishCustomVideoTrack to true.
  3. Call this method and specify videoTrackId as the video track ID set in step 2. You can then publish the corresponding custom video source in the channel.
DANGER: After calling this method, even if you stop pushing external video frames to the SDK, the custom video stream will still be counted as the video duration usage and incur charges. Agora recommends that you take appropriate measures based on the actual situation to avoid such video billing.
  • If you no longer need to capture external video data, you can call destroyCustomVideoTrack to destroy the custom video track.
  • If you only want to use the external video data for local preview and not publish it in the channel, you can call muteLocalVideoStream to cancel sending video stream or call updateChannelMediaOptions to set publishCustomVideoTrack to false.

You can push the video frame either by calling this method or by calling pushExternalVideoFrameById [2/2]. The difference is that this method does not support video data in Texture format.

Parameters

frame

The external raw video frame to be pushed. See AgoraVideoFrame.

videoTrackId
The video track ID returned by calling the createCustomVideoTrack method. The default value is 0.

Returns

  • 0: Success.
  • < 0: Failure.

pushExternalVideoFrame [1/2]

Pushes the external raw video frame to the SDK.

public abstract boolean pushExternalVideoFrame(AgoraVideoFrame frame);

Details

Deprecated:
If you need to push video frames in I422 format, you need to use this method; otherwise, use pushExternalVideoFrame [2/2].

After calling the setExternalVideoSource method and setting the enabled parameter to true, and the encodedFrame parameter to false, you can use this method to push the raw external video frame to the SDK.

You can push the video frame either by calling this method or by calling pushExternalVideoFrame [2/2]. The difference is that this method does not support video data in Texture format.

Parameters

frame

The external raw video frame to be pushed. See AgoraVideoFrame.

Returns

  • true: Success.
  • false: Failure.

pushExternalVideoFrameById [2/2]

Pushes the external raw video frame to the SDK through video tracks.

public abstract int pushExternalVideoFrameById(VideoFrame frame, int videoTrackId);

Details

To publish a custom video source, see the following steps:
  1. Call createCustomVideoTrack to create a video track and get the video track ID.
  2. Call joinChannel [2/2] to join the channel. In ChannelMediaOptions, set customVideoTrackId to the video track ID that you want to publish, and set publishCustomVideoTrack to true.
  3. Call this method and specify videoTrackId as the video track ID set in step 2. You can then publish the corresponding custom video source in the channel.
DANGER: After calling this method, even if you stop pushing external video frames to the SDK, the custom video stream will still be counted as the video duration usage and incur charges. Agora recommends that you take appropriate measures based on the actual situation to avoid such video billing.
  • If you no longer need to capture external video data, you can call destroyCustomVideoTrack to destroy the custom video track.
  • If you only want to use the external video data for local preview and not publish it in the channel, you can call muteLocalVideoStream to cancel sending video stream or call updateChannelMediaOptions to set publishCustomVideoTrack to false.

You can push the video frame either by calling this method or by calling pushExternalVideoFrameById [1/2]. The difference is that this method supports video data in the texture format.

Parameters

frame
Video frame to be pushed. See VideoFrame.
videoTrackId
The video track ID returned by calling the createCustomVideoTrack method. The default value is 0.

Returns

  • 0: Pushes the external encoded video frame to the SDK successfully.
  • < 0: Fails to push external encoded video frames to the SDK.

pushExternalVideoFrame [2/2]

Pushes the external raw video frame to the SDK.

public abstract boolean pushExternalVideoFrame(VideoFrame frame);

Details

After calling the setExternalVideoSource method and setting the enabled parameter to true, and the encodedFrame parameter to false, you can use this method to push the raw external video frame to the SDK.

You can push the video frame either by calling this method or by calling pushExternalVideoFrame [1/2]. The difference is that this method supports video data in the texture format.

Parameters

frame
Video frame to be pushed. See VideoFrame.

Returns

  • true: Success.
  • false: Failure.

queryCameraFocalLengthCapability

Queries the focal length capability supported by the camera.

public AgoraFocalLengthInfo[] queryCameraFocalLengthCapability();

Details

Since
v4.3.1

If you want to enable the wide-angle or ultra-wide-angle mode for camera capture, it is recommended to start by calling this method to check whether the device supports the required focal length capability. Then, adjust the camera's focal length configuration based on the query result by calling setCameraCapturerConfiguration, ensuring the best camera capture performance.

Returns

Returns an array of AgoraFocalLengthInfo objects, which contain the camera's orientation and focal length type.

queryDeviceScore

Queries device score.

public abstract int queryDeviceScore();

Details

Since
v4.3.0

Applicable scenarios

In high-definition or ultra-high-definition video scenarios, you can first call this method to query the device's score. If the returned score is low (for example, below 60), you need to lower the video resolution to avoid affecting the video experience. The minimum device score required for different business scenarios is varied. For specific score recommendations, please technical support.

Returns

  • >0: The method call succeeeds, the value is the current device's score, the range is [0,100], the larger the value, the stronger the device capability. Most devices are rated between 60 and 100.
  • < 0: Failure.

rate

Allows a user to rate a call after the call ends.

public abstract int rate(String callId, int rating, String description);

Details

Attention: Ensure that you call this method after leaving a channel.

Parameters

callId
The current call ID. You can get the call ID by calling getCallId.
rating
The value is between 1 (the lowest score) and 5 (the highest score).
description
(Optional) A description of the call. The string length should be less than 800 bytes.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).
    • -2: The parameter is invalid.

registerAudioEncodedFrameObserver

Registers an encoded audio observer.

public abstract int registerAudioEncodedFrameObserver(
      AudioEncodedFrameObserverConfig config, IAudioEncodedFrameObserver observer);

Details

Attention:
  • Call this method after joining a channel.
  • You can call this method or startAudioRecording [2/2] to set the recording type and quality of audio files, but Agora does not recommend using this method and startAudioRecording [2/2] at the same time. Only the method called later will take effect.

Parameters

config
Observer settings for the encoded audio. See AudioEncodedFrameObserverConfig.
observer
The encoded audio observer. See IAudioEncodedFrameObserver.

Returns

  • 0: Success.
  • < 0: Failure.

registerAudioFrameObserver

Registers an audio frame observer object.

public abstract int registerAudioFrameObserver(IAudioFrameObserver observer);

Details

Call this method to register an audio frame observer object (register a callback). When you need the SDK to trigger onMixedAudioFrame, onRecordAudioFrame, onPlaybackAudioFrame or onEarMonitoringAudioFrame callback, you need to use this method to register the callbacks.

Attention: Ensure that you call this method before joining a channel.

Parameters

observer

The observer instance. See IAudioFrameObserver. Set the value as NULL to release the instance. Agora recommends calling this method after receiving onLeaveChannel to release the audio observer object.

Returns

  • 0: Success.
  • < 0: Failure.

registerAudioSpectrumObserver

Register an audio spectrum observer.

public abstract int registerAudioSpectrumObserver(IAudioSpectrumObserver observer);

Details

After successfully registering the audio spectrum observer and calling enableAudioSpectrumMonitor to enable the audio spectrum monitoring, the SDK reports the callback that you implement in the IAudioSpectrumObserver class according to the time interval you set.

Attention: You can call this method either before or after joining a channel.

Parameters

observer

The audio spectrum observer. See IAudioSpectrumObserver.

Returns

  • 0: Success.
  • < 0: Failure.

registerExtension

Registers an extension.

public abstract int registerExtension(
      String provider, String extension, Constants.MediaSourceType sourceType);
Since
v4.1.0

For extensions external to the SDK (such as those from Extensions Marketplace and SDK Extensions), you need to load them before calling this method. Extensions internal to the SDK (those included in the full SDK package) are automatically loaded and registered after the initialization of RtcEngine.

Call timing

  • Agora recommends you call this method after the initialization of RtcEngine and before joining a channel.
  • For video extensions (such as the image enhancement extension), you need to call this method after enabling the video module by calling enableVideo or enableLocalVideo.
  • Before calling this method, you need to call addExtension to load the extension first.

Restrictions

  • If you want to register multiple extensions, you need to call this method multiple times.
  • The data processing order of different extensions in the SDK is determined by the order in which the extensions are registered. That is, the extension that is registered first will process the data first.

Parameters

provider
The name of the extension provider.
extension
The name of the extension.
sourceType
Source type of the extension. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.
    • -3: The extension library is not loaded. Agora recommends that you check the storage location or the name of the dynamic library.

registerLocalUserAccount

Registers a user account.

public abstract int registerLocalUserAccount(String appId, String userAccount);

Once registered, the user account can be used to identify the local user when the user joins the channel. After the registration is successful, the user account can identify the identity of the local user, and the user can use it to join the channel.

This method is optional. If you want to join a channel using a user account, you can choose one of the following methods:
Attention:
  • Ensure that the userAccount is unique in the channel.
  • To ensure smooth communication, use the same parameter type to identify the user. For example, if a user joins the channel with a user ID, then ensure all the other users use the user ID too. The same applies to the user account. If a user joins the channel with the Agora Web SDK, ensure that the ID of the user is set to the same parameter type.

Restrictions

None.

Parameters

appId
The App ID of your project on Agora Console.
userAccount
The user account. This parameter is used to identify the user in the channel for real-time audio and video engagement. You need to set and manage user accounts yourself and ensure that each user account in the same channel is unique. The maximum length of this parameter is 255 bytes. Ensure that you set this parameter and do not set it as NULL. Supported characters are as follow(89 in total):
  • The 26 lowercase English letters: a to z.
  • The 26 uppercase English letters: A to Z.
  • All numeric characters: 0 to 9.
  • Space
  • "!", "#", "$", "%", "&", "(", ")", "+", "-", ":", ";", "<", "=", ".", ">", "?", "@", "[", "]", "^", "_", "{", "}", "|", "~", ","

Returns

  • 0: Success.
  • < 0: Failure.

registerMediaMetadataObserver

Registers the metadata observer.

public abstract int registerMediaMetadataObserver(IMetadataObserver observer, int type);

Details

You need to implement the IMetadataObserver class and specify the metadata type in this method. This method enables you to add synchronized metadata in the video stream for more diversified live interactive streaming, such as sending shopping links, digital coupons, and online quizzes.

A successful call of this method triggers the getMaxMetadataSize callback.

Attention: Call this method before joinChannel [2/2].

Parameters

observer
The metadata observer. See IMetadataObserver.
type

The metadata type. The SDK currently only supports VIDEO_METADATA.

Returns

  • 0: Success.
  • < 0: Failure.

registerVideoEncodedFrameObserver

Registers a receiver object for the encoded video image.

public abstract int registerVideoEncodedFrameObserver(IVideoEncodedFrameObserver receiver);

Details

If you only want to observe encoded video frames (such as h.264 format) without decoding and rendering the video, Agora recommends that you implement one IVideoEncodedFrameObserver class through this method.

If you want to obtain the original video data of some remote users (referred to as group A) and the encoded video data of other remote users (referred to as group B), you can refer to the following steps:
  1. Call registerVideoFrameObserver to register the raw video frame observer before joining the channel.
  2. Call registerVideoEncodedFrameObserver to register the encoded video frame observer before joining the channel.
  3. After joining the channel, get the user IDs of group B users through onUserJoined, and then call setRemoteVideoSubscriptionOptions to set the encodedFrameOnly of this group of users to true.
  4. Call muteAllRemoteVideoStreams(false)to start receiving the video streams of all remote users. Then:
    • The raw video data of group A users can be obtained through the callback in IVideoFrameObserver, and the SDK renders the data by default.
    • The encoded video data of group B users can be obtained through the callback in IVideoEncodedFrameObserver.
Attention:
  • Call this method before joining a channel.

Parameters

receiver
The video frame observer object. See IVideoEncodedFrameObserver.

Returns

  • 0: Success.
  • < 0: Failure.

registerVideoFrameObserver

Registers a raw video frame observer object.

public abstract int registerVideoFrameObserver(IVideoFrameObserver observer);

Details

If you want to observe raw video frames (such as YUV or RGBA format), Agora recommends that you implement one IVideoFrameObserver class with this method.

When calling this method to register a video observer, you can register callbacks in the IVideoFrameObserver class as needed. After you successfully register the video frame observer, the SDK triggers the registered callbacks each time a video frame is received.

If you want to obtain the original video data of some remote users (referred to as group A) and the encoded video data of other remote users (referred to as group B), you can refer to the following steps:
  1. Call registerVideoFrameObserver to register the raw video frame observer before joining the channel.
  2. Call registerVideoEncodedFrameObserver to register the encoded video frame observer before joining the channel.
  3. After joining the channel, get the user IDs of group B users through onUserJoined, and then call setRemoteVideoSubscriptionOptions to set the encodedFrameOnly of this group of users to true.
  4. Call muteAllRemoteVideoStreams(false)to start receiving the video streams of all remote users. Then:
    • The raw video data of group A users can be obtained through the callback in IVideoFrameObserver, and the SDK renders the data by default.
    • The encoded video data of group B users can be obtained through the callback in IVideoEncodedFrameObserver.
Attention:
  • Ensure that you call this method before joining a channel.
  • When handling the video data returned in the callbacks, pay attention to the changes in the width and height parameters, which may be adapted under the following circumstances:
    • When network conditions deteriorate, the video resolution decreases incrementally.
    • If the user adjusts the video profile, the resolution of the video returned in the callbacks also changes.
Tip: After registering the raw video observer, you can use the obtained raw video data in various video pre-processing scenarios, such as implementing virtual backgrounds and image enhacement scenarios by yourself, Agora provides an open source sample project beautyapi on GitHub for your reference.

Parameters

observer
The observer instance. See IVideoFrameObserver. To release the instance, set the value as NULL.

Returns

  • 0: Success.
  • < 0: Failure.

destroy

Releases the RtcEngine instance.

public static synchronized void destroy() {
                if (mInstance == null)
                return;
                mInstance.doDestroy();
                mInstance = null;
                System.gc();
                }
            

Details

This method releases all resources used by the Agora SDK. Use this method for apps in which users occasionally make voice or video calls. When users do not make calls, you can free up resources for other operations.

After a successful method call, you can no longer use any method or callback in the SDK anymore. If you want to use the real-time communication functions again, you must call create [2/2] to create a new RtcEngine instance.

Attention:
  • This method can be called synchronously. You need to wait for the resource of RtcEngine to be released before performing other operations (for example, create a new RtcEngine object). Therefore, Agora recommends calling this method in the child thread to avoid blocking the main thread.
  • Besides, Agora does not recommend you calling destroy in any callback of the SDK. Otherwise, the SDK cannot release the resources until the callbacks return results, which may result in a deadlock.

removeHandler

Removes the specified IRtcEngineEventHandler instance.

public void removeHandler(IRtcEngineEventHandler handler) {
                mInstance.removeHandler(handler);
              }

Details

This method removes the specified callback handler. For callback events that you want to listen for only once, call this method to remove the relevant callback handler after you have received them.

Parameters

handler
The callback handler to be deleted. See IRtcEngineEventHandler.

Returns

renewToken

Renews the token.

public abstract int renewToken(String token);

You can call this method to pass a new token to the SDK. A token will expire after a certain period of time, at which point the SDK will be unable to establish a connection with the server.

Call timing

In any of the following cases, Agora recommends that you generate a new token on your server and then call this method to renew your token:

Restrictions

None.

Parameters

token
The new token.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid. For example, the token is empty.
    • -7: The RtcEngine object has not been initialized. You need to initialize the RtcEngine object before calling this method.
    • 110: Invalid token. Ensure the following:
      • The user ID specified when generating the token is consistent with the user ID used when joining the channel.
      • The generated token is the same as the token passed in to join the channel.

resumeAudioMixing

Resumes playing and mixing the music file.

public abstract int resumeAudioMixing();

Details

This method resumes playing and mixing the music file. Call this method when you are in a channel.

Returns

  • 0: Success.
  • < 0: Failure.

selectAudioTrack

Selects the audio track used during playback.

 public abstract int selectAudioTrack(int audioIndex);

Details

After getting the track index of the audio file, you can call this method to specify any track to play. For example, if different tracks of a multi-track file store songs in different languages, you can call this method to set the playback language.

Note:

Parameters

audioIndex
The audio track you want to specify. The value range is [0, getAudioTrackCount()].

Returns

  • 0: Success.
  • < 0: Failure.

selectMultiAudioTrack

Selects the audio tracks that you want to play on your local device and publish to the channel respectively.

int selectMultiAudioTrack(int playoutTrackIndex, int publishTrackIndex);

Details

Since
v4.3.0

You can call this method to determine the audio track to be played on your local device and published to the channel.

Before calling this method, you need to open the media file with the openWithMediaSource method and set enableMultiAudioTrack in MediaPlayerSource as true.

Applicable scenarios

For example, in KTV scenarios, the host can choose to play the original sound locally and publish the accompaniment track to the channel.

Parameters

playoutTrackIndex
The index of audio tracks for local playback. You can obtain the index through getStreamInfo.
publishTrackIndex
The index of audio tracks to be published in the channel. You can obtain the index through getStreamInfo.

Returns

  • 0: Success.
  • < 0: Failure.

sendCustomReportMessage

Reports customized messages.

public abstract int sendCustomReportMessage(
      String id, String category, String event, String label, int value);

Details

Agora supports reporting and analyzing customized messages. This function is in the beta stage with a free trial. The ability provided in its beta test version is reporting a maximum of 10 message pieces within 6 seconds, with each message piece not exceeding 256 bytes and each string not exceeding 100 bytes. To try out this function, contact support@agora.io and discuss the format of customized messages with us.

sendStreamMessage

Sends data stream messages.

public abstract int sendStreamMessage(int streamId, byte[] message);

Details

Sends data stream messages to all users in a channel. The SDK has the following restrictions on this method:
  • Up to 30 packets can be sent per second in a channel with each packet having a maximum size of 1 KB.
  • Each client can send up to 6 KB of data per second.
  • Each user can have up to five data streams simultaneously.

A successful method call triggers the onStreamMessage callback on the remote client, from which the remote user gets the stream message. A failed method call triggers the onStreamMessageError callback on the remote client.

Attention:
  • Ensure that you call createDataStream [2/2] to create a data channel before calling this method.
  • In live streaming scenarios, this method only applies to hosts.

Parameters

streamId
The data stream ID. You can get the data stream ID by calling createDataStream [2/2].
message
The message to be sent.

Returns

  • 0: Success.
  • < 0: Failure.

setAdvancedAudioOptions

Sets audio advanced options.

public abstract int SetAdvancedAudioOptions(AdvancedAudioOptions options);

Details

If you have advanced audio processing requirements, such as capturing and sending stereo audio, you can call this method to set advanced audio options.

Attention: Call this method after calling joinChannel [2/2], enableAudio and enableLocalAudio.

Parameters

options
The advanced options for audio. See AdvancedAudioOptions.

Returns

  • 0: Success.
  • < 0: Failure.

setAINSMode

Sets whether to enable the AI ​​noise suppression function and set the noise suppression mode.

public abstract int setAINSMode(boolean enabled, int mode);

Details

Since
v4.2.0
You can call this method to enable AI noise suppression function. Once enabled, the SDK automatically detects and reduces stationary and non-stationary noise from your audio on the premise of ensuring the quality of human voice. Stationary noise refers to noise signal with constant average statistical properties and negligibly small fluctuations of level within the period of observation. Common sources of stationary noises are:
  • Television;
  • Air conditioner;
  • Machinery, etc.
Non-stationary noise refers to noise signal with huge fluctuations of level within the period of observation; common sources of non-stationary noises are:
  • Thunder;
  • Explosion;
  • Cracking, etc.
Note:
  • This method relies on the AI noise suppression dynamic library libagora_ai_noise_suppression_extension.so. If the dynamic library is deleted, the function cannot be enabled.
  • Agora does not recommend enabling this function on devices running Android 6.0 and below.

Applicable scenarios

In scenarios such as co-streaming, online education and video meeting, this function can detect and reduce background noises to improve experience.

Parameters

enabled
Whether to enable the AI noise suppression function:
  • true: Enable the AI noise suppression.
  • false: (Default) Disable the AI noise suppression.
mode
The AI noise suppression modes:
  • 0: (Default) Balance mode. This mode allows for a balanced performance on noice suppression and time delay.
  • 1: Aggressive mode. In scenarios where high performance on noise suppression is required, such as live streaming outdoor events, this mode reduces nosies more dramatically, but sometimes may affect the original character of the audio.
  • 2: Aggressive mode with low latency. The noise suppression delay of this mode is about only half of that of the balance and aggressive modes. It is suitable for scenarios that have high requirements on noise suppression with low latency, such as sing together online in real time.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioEffectParameters

Sets parameters for SDK preset audio effects.

public abstract int setAudioEffectParameters(int preset, int param1, int param2);

Details

Call this method to set the following parameters for the local user who sends an audio stream:
  • 3D voice effect: Sets the cycle period of the 3D voice effect.
  • Pitch correction effect: Sets the basic mode and tonic pitch of the pitch correction effect. Different songs have different modes and tonic pitches. Agora recommends bounding this method with interface elements to enable users to adjust the pitch correction interactively.

After setting the audio parameters, all users in the channel can hear the effect.

To achieve better vocal effects, it is recommended that you call the following APIs before calling this method:
  • Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely AUDIO_SCENARIO_GAME_STREAMING(3).
  • Call setAudioProfile [2/2] to set the profile parameter to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5).
Attention:

Parameters

preset
The options for SDK preset audio effects:
  • ROOM_ACOUSTICS_3D_VOICE, 3D voice effect:
    • You need to set the profile parameter in setAudioProfile [2/2] to MUSIC_STANDARD_STEREO(3) or MUSIC_HIGH_QUALITY_STEREO(5) before setting this enumerator; otherwise, the enumerator setting does not take effect.
    • If the 3D voice effect is enabled, users need to use stereo audio playback devices to hear the anticipated voice effect.
  • PITCH_CORRECTION, Pitch correction effect:
param1
  • If you set preset to ROOM_ACOUSTICS_3D_VOICE, param1 sets the cycle period of the 3D voice effect. The value range is [1,60] and the unit is seconds. The default value is 10, indicating that the voice moves around you every 10 seconds.
  • If you set preset to PITCH_CORRECTION, param1 indicates the basic mode of the pitch correction effect:
    • 1: (Default) Natural major scale.
    • 2: Natural minor scale.
    • 3: Japanese pentatonic scale.
param2
  • If you set preset to ROOM_ACOUSTICS_3D_VOICE , you need to set param2 to 0.
  • If you set preset to PITCH_CORRECTION, param2 indicates the tonic pitch of the pitch correction effect:
    • 1: A
    • 2: A#
    • 3: B
    • 4: (Default) C
    • 5: C#
    • 6: D
    • 7: D#
    • 8: E
    • 9: F
    • 10: F#
    • 11: G
    • 12: G#

Returns

  • 0: Success.
  • < 0: Failure.

setAudioEffectPreset

Sets an SDK preset audio effect.

public abstract int setAudioEffectPreset(int preset);

Details

Call this method to set an SDK preset audio effect for the local user who sends an audio stream. This audio effect does not change the gender characteristics of the original voice. After setting an audio effect, all users in the channel can hear the effect.

To achieve better vocal effects, it is recommended that you call the following APIs before calling this method:
  • Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely AUDIO_SCENARIO_GAME_STREAMING(3).
  • Call setAudioProfile [2/2] to set the profile parameter to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5).
Attention:
  • You can call this method either before or after joining a channel.
  • Do not set the profile parameter in setAudioProfile [2/2] to SPEECH_STANDARD(1), or the method does not take effect.
  • If you call setAudioEffectPreset and set enumerators except for ROOM_ACOUSTICS_3D_VOICE or PITCH_CORRECTION, do not call setAudioEffectParameters; otherwise, setAudioEffectPreset is overridden.
  • After calling setAudioEffectPreset, Agora does not recommend you to call the following methods, otherwise the effect set by setAudioEffectPreset will be overwritten:
  • This method relies on the voice beautifier dynamic library libagora_audio_beauty_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

preset
Preset audio effects.
  • AUDIO_EFFECT_OFF: Turn off audio effects and use the original voice.
  • ROOM_ACOUSTICS_KTV: The reverberation style typical of a KTV venue.
  • ROOM_ACOUSTICS_VOCAL_CONCERT: The reverberation style typical of a concert hall.
  • ROOM_ACOUSTICS_STUDIO: The reverberation style typical of a recording studio.
  • ROOM_ACOUSTICS_PHONOGRAPH: The reverberation style typical of the vintage phonograph.
  • ROOM_ACOUSTICS_VIRTUAL_STEREO: A virtual stereo effect that renders monophonic audio as stereo audio. Before using this preset, set the profile parameter of setAudioProfile [2/2] to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5) ; otherwise, the preset setting is invalid.
  • ROOM_ACOUSTICS_SPACIAL: A more spatial audio effect.
  • ROOM_ACOUSTICS_ETHEREAL: A more ethereal audio effect.
  • ROOM_ACOUSTICS_VIRTUAL_SURROUND_SOUND: Virtual surround sound, that is, the SDK generates a simulated surround sound field on the basis of stereo channels, thereby creating a surround sound effect.
    Attention: If the virtual surround sound is enabled, users need to use stereo audio playback devices to hear the anticipated audio effect.
  • ROOM_ACOUSTICS_CHORUS: A chorus audio effect. Agora recommends using this effect in chorus scenarios to enhance the sense of depth and dimension in the vocals.
  • ROOM_ACOUSTICS_3D_VOICE: A 3D voice effect that makes the voice appear to be moving around the user. The default cycle period is 10 seconds. After setting this effect, you can call setAudioEffectParameters to modify the movement period.
    • Before using this preset, set the profile parameter of setAudioProfile [2/2] to MUSIC_STANDARD_STEREO(3) or MUSIC_HIGH_QUALITY_STEREO(5); otherwise, the preset setting is invalid.
    • If the 3D voice effect is enabled, users need to use stereo audio playback devices to hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_UNCLE: The reverberation style typical of an uncle's voice. Agora recommends using this preset to process a male-sounding voice; otherwise, you may not hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_OLDMAN: The voice of an old man. Agora recommends using this preset to process a male-sounding voice; otherwise, you may not hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_BOY: The voice of a boy. Agora recommends using this preset to process a male-sounding voice; otherwise, you may not hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_SISTER: The voice of a young woman. Agora recommends using this preset to process a female-sounding voice; otherwise, you may not hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_GIRL: The voice of a girl. Agora recommends using this preset to process a female-sounding voice; otherwise, you may not hear the anticipated voice effect.
  • VOICE_CHANGER_EFFECT_PIGKING: The voice of Pig King, a character in Journey to the West who has a voice like a growling bear.
  • VOICE_CHANGER_EFFECT_HULK: The voice of the Hulk.
  • STYLE_TRANSFORMATION_RNB: The reverberation style typical of R&B music. Before using this preset, set the profile parameter of setAudioProfile [2/2] to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5) ; otherwise, the preset setting is invalid.
  • STYLE_TRANSFORMATION_POPULAR: The reverberation style typical of popular music. Before using this preset, set the profile parameter of setAudioProfile [2/2] to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5) ; otherwise, the preset setting is invalid.
  • PITCH_CORRECTION: A pitch correction effect that corrects the user's pitch based on the pitch of the natural C major scale. After setting this voice effect, you can call setAudioEffectParameters to adjust the basic mode of tuning and the pitch of the main tone.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioMixingDualMonoMode

Sets the channel mode of the current audio file.

public abstract int setAudioMixingDualMonoMode(Constants.AudioMixingDualMonoMode mode);

Details

In a stereo music file, the left and right channels can store different audio data. According to your needs, you can set the channel mode to original mode, left channel mode, right channel mode, or mixed channel mode. For example, in the KTV scenario, the left channel of the music file stores the musical accompaniment, and the right channel stores the singing voice. If you only need to listen to the accompaniment, call this method to set the channel mode of the music file to left channel mode; if you need to listen to the accompaniment and the singing voice at the same time, call this method to set the channel mode to mixed channel mode.

Attention:

Parameters

mode
The channel mode. See AudioMixingDualMonoMode.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioMixingPitch

Sets the pitch of the local music file.

public abstract int setAudioMixingPitch(int pitch);

Details

When a local music file is mixed with a local human voice, call this method to set the pitch of the local music file only.

Attention: You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Parameters

pitch
Sets the pitch of the local music file by the chromatic scale. The default value is 0, which means keeping the original pitch. The value ranges from -12 to 12, and the pitch value between consecutive values is a chromatic value. The greater the absolute value of this parameter, the higher or lower the pitch of the local music file.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioMixingPlaybackSpeed

Sets the playback speed of the current audio file.

 public abstract int setAudioMixingPlaybackSpeed(int speed);

Details

Since
v4.3.1

Ensure you call this method after calling startAudioMixing [2/2] receiving the onAudioMixingStateChanged callback reporting the state as AUDIO_MIXING_STATE_PLAYING.

Parameters

speed
The playback speed. Agora recommends that you set this to a value between 50 and 400, defined as follows:
  • 50: Half the original speed.
  • 100: The original speed.
  • 400: 4 times the original speed.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioMixingPosition

Sets the audio mixing position.

public abstract int setAudioMixingPosition(int pos);

Details

Call this method to set the playback position of the music file to a different starting position (the default plays from the beginning).

Attention: You need to call this method after calling startAudioMixing [2/2] and receiving the onAudioMixingStateChanged(AUDIO_MIXING_STATE_PLAYING) callback.

Parameters

pos
Integer. The playback position (ms).

Returns

  • 0: Success.
  • < 0: Failure.

setAudioProfile [1/2]

Sets the audio profile and audio scenario.

public abstract int setAudioProfile(int profile, int scenario);
Deprecated:
This method is deprecated. If you need to set the audio profile, use setAudioProfile [2/2]; if you need to set the audio scenario, use setAudioScenario.

Applicable scenarios

This method is suitable for various audio scenarios. You can choose as needed. For example, in scenarios with high audio quality requirements such as music teaching, it is recommended to set profile to MUSIC_HIGH_QUALITY(4) and scenario to AUDIO_SCENARIO_GAME_STREAMING(3).

Call timing

You can call this method either before or after joining a channel.

Restrictions

None.

Parameters

profile
The audio profile, including the sampling rate, bitrate, encoding mode, and the number of channels.
  • DEFAULT(0): The default value.
    • For the interactive streaming profile: A sample rate of 48 kHz, music encoding, mono, and a bitrate of up to 64 Kbps.
    • For the communication profile: A sample rate of 32 kHz, audio encoding, mono, and a bitrate of up to 18 Kbps.
  • SPEECH_STANDARD(1): A sampling rate of 32 kHz, audio encoding, mono, and a bitrate of up to 18 Kbps.
  • MUSIC_STANDARD(2): A sampling rate of 48 kHz, music encoding, mono, and a bitrate of up to 64 Kbps.
  • MUSIC_STANDARD_STEREO(3): A sampling rate of 48 kHz, music encoding, stereo, and a bitrate of up to 80 Kbps.
  • MUSIC_HIGH_QUALITY(4): A sampling rate of 48 kHz, music encoding, mono, and a bitrate of up to 96 Kbps.
  • MUSIC_HIGH_QUALITY_STEREO(5): A sampling rate of 48 kHz, music encoding, stereo, and a bitrate of up to 128 Kbps.
scenario
The audio scenarios. Under different audio scenarios, the device uses different volume types.
  • AUDIO_SCENARIO_DEFAULT(0): (Default) Automatic scenario, where the SDK chooses the appropriate audio quality according to the user role and audio route.
  • AUDIO_SCENARIO_GAME_STREAMING(3): High-quality audio scenario, where users mainly play music.
  • AUDIO_SCENARIO_CHATROOM(5): Chatroom scenario, where users need to frequently switch the user role or mute and unmute the microphone. In this scenario, audience members receive a pop-up window to request permission of using microphones.
  • AUDIO_SCENARIO_CHORUS(7): Real-time chorus scenario, where users have good network conditions and require ultra-low latency.
    Attention: Before using this enumeration, you need to call getAudioDeviceInfo to see whether the audio device supports ultra-low-latency capture and playback. To experience ultra-low latency, you need to ensure that your audio device supports ultra-low latency (isLowLatencyAudioSupported = true).
  • AUDIO_SCENARIO_MEETING(8): Meeting scenario that mainly involves the human voice.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioProfile [2/2]

Sets audio profiles.

public synchronized int setAudioProfile(int profile)

If you need to set the audio scenario, you can either call setAudioScenario, or create [2/2] and set the mAudioScenario in RtcEngineConfig.

Applicable scenarios

This method is suitable for various audio scenarios. You can choose as needed. For example, in scenarios with high audio quality requirements such as music teaching, it is recommended to set profile to MUSIC_HIGH_QUALITY(4).

Call timing

You can call this method either before or after joining a channel.

Restrictions

None.

Parameters

profile
The audio profile, including the sampling rate, bitrate, encoding mode, and the number of channels.
  • DEFAULT(0): The default value.
    • For the interactive streaming profile: A sample rate of 48 kHz, music encoding, mono, and a bitrate of up to 64 Kbps.
    • For the communication profile: A sample rate of 32 kHz, audio encoding, mono, and a bitrate of up to 18 Kbps.
  • SPEECH_STANDARD(1): A sampling rate of 32 kHz, audio encoding, mono, and a bitrate of up to 18 Kbps.
  • MUSIC_STANDARD(2): A sampling rate of 48 kHz, music encoding, mono, and a bitrate of up to 64 Kbps.
  • MUSIC_STANDARD_STEREO(3): A sampling rate of 48 kHz, music encoding, stereo, and a bitrate of up to 80 Kbps.
  • MUSIC_HIGH_QUALITY(4): A sampling rate of 48 kHz, music encoding, mono, and a bitrate of up to 96 Kbps.
  • MUSIC_HIGH_QUALITY_STEREO(5): A sampling rate of 48 kHz, music encoding, stereo, and a bitrate of up to 128 Kbps.

Returns

  • 0: Success.
  • < 0: Failure.

setAudioScenario

Sets audio scenarios.

public abstract int setAudioScenario(int scenario);

Applicable scenarios

This method is suitable for various audio scenarios. You can choose as needed. For example, in scenarios such as music teaching that require high sound quality, it is recommended to set scenario to AUDIO_SCENARIO_GAME_STREAMING(3).

Call timing

You can call this method either before or after joining a channel.

Restrictions

None.

Parameters

scenario
The audio scenarios. Under different audio scenarios, the device uses different volume types.
  • AUDIO_SCENARIO_DEFAULT(0): (Default) Automatic scenario, where the SDK chooses the appropriate audio quality according to the user role and audio route.
  • AUDIO_SCENARIO_GAME_STREAMING(3): High-quality audio scenario, where users mainly play music.
  • AUDIO_SCENARIO_CHATROOM(5): Chatroom scenario, where users need to frequently switch the user role or mute and unmute the microphone. In this scenario, audience members receive a pop-up window to request permission of using microphones.
  • AUDIO_SCENARIO_CHORUS(7): Real-time chorus scenario, where users have good network conditions and require ultra-low latency.
    Attention: Before using this enumeration, you need to call getAudioDeviceInfo to see whether the audio device supports ultra-low-latency capture and playback. To experience ultra-low latency, you need to ensure that your audio device supports ultra-low latency (isLowLatencyAudioSupported = true).
  • AUDIO_SCENARIO_MEETING(8): Meeting scenario that mainly involves the human voice.

Returns

  • 0: Success.
  • < 0: Failure.

setBeautyEffectOptions [1/2]

Sets the image enhancement options.

public abstract int setBeautyEffectOptions(boolean enabled, BeautyOptions options);

Details

Enables or disables image enhancement, and sets the options.

Note:
  • Call this method after calling enableVideo or startPreview [2/2].
  • This method only applies to Android 5.0 or later.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.
  • This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device.

Parameters

enabled
Whether to enable the image enhancement function:
  • true: Enable the image enhancement function.
  • false: (Default) Disable the image enhancement function.
options
The image enhancement options. See BeautyOptions.

Returns

  • 0: Success.
  • < 0: Failure.
    • -4: The current device does not support this feature. Possible reasons include:
      • The current device capabilities do not meet the requirements for image enhancement. Agora recommends you replace it with a high-performance device.
      • The current device version is lower than Android 5.0 and does not support this feature. Agora recommends you replace the device or upgrade the operating system.

setBeautyEffectOptions [2/2]

Sets the image enhancement options and specifies the media source.

public abstract int setBeautyEffectOptions(
      boolean enabled, BeautyOptions options, Constants.MediaSourceType sourceType);

Details

Enables or disables image enhancement, and sets the options.

Both this method and setBeautyEffectOptions [1/2] set image enhancement options, but this method allows you to specify the media source to which the image enhancement is applied.

Note:
  • Call this method after calling enableVideo or startPreview [2/2].
  • This method only applies to Android 5.0 or later.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.
  • This feature has high requirements on device performance. When calling this method, the SDK automatically checks the capabilities of the current device.

Parameters

enabled
Whether to enable the image enhancement function:
  • true: Enable the image enhancement function.
  • false: (Default) Disable the image enhancement function.
options
The image enhancement options. See BeautyOptions.
sourceType
The media source type to which the effect is applied. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.
    • -4: The current device does not support this feature. Possible reasons include:
      • The current device capabilities do not meet the requirements for image enhancement. Agora recommends you replace it with a high-performance device.
      • The current device version is lower than Android 5.0 and does not support this feature. Agora recommends you replace the device or upgrade the operating system.

setCameraAutoFocusFaceModeEnabled

Enables the camera auto-face focus function.

public abstract int setCameraAutoFocusFaceModeEnabled(boolean enabled);

Details

The SDK disables face autofocus by default. To set face autofocus, call this method.

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).

Parameters

enabled
Whether to enable face autofocus:
  • true: Enable the camera auto-face focus function.
  • false: Disable face autofocus.

Returns

  • 0: Success.
  • < 0: Failure.

setCameraCapturerConfiguration

Sets the camera capture configuration.

public abstract int setCameraCapturerConfiguration(CameraCapturerConfiguration config);

Details

Attention:
  • Call this method before enabling local camera capture, such as before calling startPreview [2/2] and joinChannel [2/2].
  • To adjust the camera focal length configuration, It is recommended to call queryCameraFocalLengthCapability first to check the device's focal length capabilities, and then configure based on the query results.
  • Due to limitations on some Android devices, even if you set the focal length type according to the results returned in queryCameraFocalLengthCapability, the settings may not take effect.

Parameters

config
The camera capture configuration. See CameraCapturerConfiguration.

Returns

  • 0: Success.
  • < 0: Failure.

setCameraExposureFactor

Sets the camera exposure value.

public abstract int setCameraExposureFactor(int factor);

Details

Since
v4.2.2

Insufficient or excessive lighting in the shooting environment can affect the image quality of video capture. To achieve optimal video quality, you can use this method to adjust the camera's exposure value.

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).
  • Before calling this method, Agora recommends calling isCameraExposureSupported to check whether the current camera supports adjusting the exposure value.
  • By calling this method, you adjust the exposure value of the currently active camera, that is, the camera specified when calling setCameraCapturerConfiguration.

Parameters

factor

The camera exposure value. The default value is 0, which means using the default exposure of the camera. The larger the value, the greater the exposure. When the video image is overexposed, you can reduce the exposure value; when the video image is underexposed and the dark details are lost, you can increase the exposure value. If the exposure value you specified is beyond the range supported by the device, the SDK will automatically adjust it to the actual supported range of the device.

The value range is [-20, 20].

Returns

setCameraExposurePosition

Sets the camera exposure position.

public abstract int setCameraExposurePosition(float positionXinView, float positionYinView);

Details

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).
  • After a successful method call, the SDK triggers the onCameraExposureAreaChanged callback.

Parameters

positionXinView
The horizontal coordinate of the touchpoint in the view.
positionYinView
The vertical coordinate of the touchpoint in the view.

Returns

  • 0: Success.
  • < 0: Failure.

setCameraFocusPositionInPreview

Sets the camera manual focus position.

public abstract int setCameraFocusPositionInPreview(float positionX, float positionY);

Details

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).
  • After a successful method call, the SDK triggers the onCameraFocusAreaChanged callback.

Parameters

positionX
The horizontal coordinate of the touchpoint in the view.
positionY
The vertical coordinate of the touchpoint in the view.

Returns

  • 0: Success.
  • < 0: Failure.

setCameraTorchOn

Enables the camera flash.

public abstract int setCameraTorchOn(boolean isOn);

Details

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).

Parameters

isOn
Whether to turn on the camera flash:
  • true: Turn on the flash.
  • false: (Default) Turn off the flash.

Returns

  • 0: Success.
  • < 0: Failure.

setCameraZoomFactor

Sets the camera zoom factor.

public abstract int setCameraZoomFactor(float factor);

Details

Attention:
  • You must call this method after enableVideo. The setting result will take effect after the camera is successfully turned on, that is, after the SDK triggers the onLocalVideoStateChanged callback and returns the local video state as LOCAL_VIDEO_STREAM_STATE_CAPTURING (1).

Parameters

factor
The camera zoom factor. For devices that do not support ultra-wide-angle, the value ranges from 1.0 to the maximum zoom factor; for devices that support ultra-wide-angle, the value ranges from 0.5 to the maximum zoom factor. You can get the maximum zoom factor supported by the device by calling the getCameraMaxZoomFactor method.

Returns

  • The camera zoom factor value, if successful.
  • < 0: if the method if failed.

setChannelProfile

Sets the channel profile.

public abstract int setChannelProfile(int profile);

You can call this method to set the channel profile. The SDK adopts different optimization strategies for different channel profiles. For example, in a live streaming scenario, the SDK prioritizes video quality. After initializing the SDK, the default channel profile is the live streaming profile.

Attention:

In different channel scenarios, the default audio routing of the SDK is different. See setDefaultAudioRouteToSpeakerphone.

Call timing

Ensure that you call this method before joining a channel.

Restrictions

To ensure the quality of real-time communication, Agora recommends that all users in a channel use the same channel profile.

Parameters

profile
The channel profile.
  • CHANNEL_PROFILE_COMMUNICATION(0): Communication. Agora recommends using the live streaming profile for a better audio and video experience.
  • CHANNEL_PROFILE_LIVE_BROADCASTING(1): (Default) Live streaming.
  • CHANNEL_PROFILE_GAME(2): Gaming.
    Deprecated:
    Use CHANNEL_PROFILE_LIVE_BROADCASTING instead.
  • CHANNEL_PROFILE_CLOUD_GAMING(3): Interaction. The scenario is optimized for latency. Use this profile if the use case requires frequent interactions between users.
    Deprecated:
    Use CHANNEL_PROFILE_LIVE_BROADCASTING instead.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid.
    • -7: The SDK is not initialized.

setClientRole [1/2]

Sets the client role.

public abstract int setClientRole(int role);

By default,the SDK sets the user role as audience. You can call this method to set the user role as host. The user role (roles) determines the users' permissions at the SDK level, including whether they can publish audio and video streams in a channel.

Call timing

You can call this method either before or after joining a channel.

If you call this method to set the user role as the host before joining the channel and set the local video property through the setupLocalVideo method, the local video preview is automatically enabled when the user joins the channel.

If you call this method to set the user role after joining a channel, the SDK will automatically call the muteLocalAudioStream and muteLocalVideoStream method to change the state for publishing audio and video streams.

Restrictions

When calling this method before joining a channel and setting the user role to BROADCASTER, the onClientRoleChanged callback will not be triggered on the local client.

Parameters

role
The user role:
  • CLIENT_ROLE_BROADCASTER(1): Host.
  • CLIENT_ROLE_AUDIENCE(2): Audience.
Note: If you set the user role as an audience member, you cannot publish audio and video streams in the channel. If you want to publish media streams in a channel during live streaming, ensure you set the user role as broadcaster.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).
    • -2: The parameter is invalid.
    • -7: The SDK is not initialized.

setClientRole [2/2]

Set the user role and the audience latency level in a live streaming scenario.

public abstract int setClientRole(int role, ClientRoleOptions options);

By default,the SDK sets the user role as audience. You can call this method to set the user role as host. The user role (roles) determines the users' permissions at the SDK level, including whether they can publish audio and video streams in a channel.

The difference between this method and setClientRole [1/2] is that, the former supports setting the audienceLatencyLevel. audienceLatencyLevel needs to be used together with role to determine the level of service that users can enjoy within their permissions. For example, an audience member can choose to receive remote streams with low latency or ultra-low latency. Latency of different levels differ in billing. See .

Call timing

You can call this method either before or after joining a channel.

If you call this method to set the user role as the host before joining the channel and set the local video property through the setupLocalVideo method, the local video preview is automatically enabled when the user joins the channel.

If you call this method to set the user role after joining a channel, the SDK will automatically call the muteLocalAudioStream and muteLocalVideoStream method to change the state for publishing audio and video streams.

Restrictions

When the user role is set to host, the audience latency level can only be set to AUDIENCE_LATENCY_LEVEL_ULTRA_LOW_LATENCY.

When calling this method before joining a channel and setting the role to BROADCASTER, the onClientRoleChanged callback will not be triggered on the local client.

Parameters

role
The user role.
  • CLIENT_ROLE_BROADCASTER(1): Host. A host can both send and receive streams.
  • CLIENT_ROLE_AUDIENCE(2): (Default) Audience. An audience member can only receive streams.
Note: If you set the user role as an audience member, you cannot publish audio and video streams in the channel. If you want to publish media streams in a channel during live streaming, ensure you set the user role as broadcaster.
options
The detailed options of a user, including the user level. See ClientRoleOptions.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).
    • -2: The parameter is invalid.
    • -5: The request is rejected.
    • -7: The SDK is not initialized.

setCloudProxy

Sets up cloud proxy service.

public abstract int setCloudProxy(int proxyType);

Details

When users' network access is restricted by a firewall, configure the firewall to allow specific IP addresses and ports provided by Agora; then, call this method to enable the cloud proxyType and set the cloud proxy type with the proxyType parameter.

After successfully connecting to the cloud proxy, the SDK triggers the onConnectionStateChanged (CONNECTION_STATE_CONNECTING, CONNECTION_CHANGED_SETTING_PROXY_SERVER) callback.

To disable the cloud proxy that has been set, call the setCloudProxy(TRANSPORT_TYPE_NONE_PROXY).

To change the cloud proxy type that has been set, call the setCloudProxy(TRANSPORT_TYPE_NONE_PROXY) first, and then call the setCloudProxy to set the proxyType you want.

Attention:
  • Agora recommends that you call this method after joining a channel.
  • When a user is behind a firewall and uses the Force UDP cloud proxy, the services for Media Push and cohosting across channels are not available.
  • When you use the Force TCP cloud proxy, note that an error would occur when calling the startAudioMixing [2/2] method to play online music files in the HTTP protocol. The services for Media Push and cohosting across channels use the cloud proxy with the TCP protocol.

Parameters

proxyType
The type of the cloud proxy.
  • TRANSPORT_TYPE_NONE_PROXY(0): The automatic mode. The SDK has this mode enabled by default. In this mode, the SDK attempts a direct connection to SD-RTN™ and automatically switches to TCP/TLS 443 if the attempt fails.
  • TRANSPORT_TYPE_UDP_PROXY(1): The cloud proxy for the UDP protocol, that is, the Force UDP cloud proxy mode. In this mode, the SDK always transmits data over UDP.
  • TRANSPORT_TYPE_TCP_PROXY(2): The cloud proxy for the TCP (encryption) protocol, that is, the Force TCP cloud proxy mode. In this mode, the SDK always transmits data over TCP/TLS 443.

This parameter is mandatory. The SDK reports an error if you do not pass in a value.

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: The parameter is invalid.
    • -7: The SDK is not initialized.

setColorEnhanceOptions [1/2]

Sets color enhancement.

public abstract int setColorEnhanceOptions(boolean enabled, ColorEnhanceOptions options);

Details

The video images captured by the camera can have color distortion. The color enhancement feature intelligently adjusts video characteristics such as saturation and contrast to enhance the video color richness and color reproduction, making the video more vivid.

You can call this method to enable the color enhancement feature and set the options of the color enhancement effect.

Attention:
  • Call this method after calling enableVideo.
  • The color enhancement feature has certain performance requirements on devices. With color enhancement turned on, Agora recommends that you change the color enhancement level to one that consumes less performance or turn off color enhancement if your device is experiencing severe heat problems.
  • Both this method and setExtensionProperty can enable color enhancement:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable color enhancement:
  • true Enable color enhancement.
  • false: (Default) Disable color enhancement.
options
The color enhancement options. See ColorEnhanceOptions.

Returns

  • 0: Success.
  • < 0: Failure.

setColorEnhanceOptions [2/2]

Sets color enhance options and specifies the media source.

public abstract int setColorEnhanceOptions(
      boolean enabled, ColorEnhanceOptions options, Constants.MediaSourceType sourceType);

Details

The video images captured by the camera can have color distortion. The color enhancement feature intelligently adjusts video characteristics such as saturation and contrast to enhance the video color richness and color reproduction, making the video more vivid.

Both this method and setColorEnhanceOptions [1/2] set color enhancement options, but this method allows you to specify the media source to which the color enhance options are applied.

Attention:
  • Call this method after calling enableVideo.
  • The color enhancement feature has certain performance requirements on devices. With color enhancement turned on, Agora recommends that you change the color enhancement level to one that consumes less performance or turn off color enhancement if your device is experiencing severe heat problems.
  • Both this method and setExtensionProperty can enable color enhancement:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable color enhancement:
  • true Enable color enhancement.
  • false: (Default) Disable color enhancement.
options
The color enhancement options. See ColorEnhanceOptions.
sourceType
The media source type to which the effect is applied. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.

setDefaultAudioRouteToSpeakerphone

Sets the default audio playback route.

public abstract int setDefaultAudioRoutetoSpeakerphone(boolean defaultToSpeaker);

Details

Note:
  • Ensure that you call this method before joining a channel. If you need to change the audio route after joining a channel, call setEnableSpeakerphone.

Most mobile phones have two audio routes: an earpiece at the top, and a speakerphone at the bottom. The earpiece plays at a lower volume, and the speakerphone at a higher volume. When setting the default audio route, you determine whether audio playback comes through the earpiece or speakerphone when no external audio device is connected.

In different scenarios, the default audio routing of the system is also different. See the following:
  • Voice call: Earpiece.
  • Audio broadcast: Speakerphone.
  • Video call: Speakerphone.
  • Video broadcast: Speakerphone.

You can call this method to change the default audio route. After a successful method call, the SDK triggers the onAudioRouteChanged callback.

Note:

The system audio route changes when an external audio device, such as a headphone or a Bluetooth audio device, is connected. See Audio Route for detailed change principles.

Parameters

defaultToSpeaker
Whether to set the speakerphone as the default audio route:
  • true: Set the speakerphone as the default audio route.
  • false: Set the earpiece as the default audio route.

Returns

  • 0: Success.
  • < 0: Failure.

setDualStreamMode [1/2]

Sets the dual-stream mode on the sender side.

public abstract int setDualStreamMode(Constants.SimulcastStreamMode mode);

Details

Since
v4.0.1
The SDK defaults to enabling low-quality video stream adaptive mode (AUTO_SIMULCAST_STREAM) on the sender side, which means the sender does not actively send low-quality video stream. The receiving end with the role of the host can initiate a low-quality video stream request by calling setRemoteVideoStreamType, and upon receiving the request, the sending end automatically starts sending low-quality stream.
  • If you want to modify this behavior, you can call this method and set mode to DISABLE_SIMULCAST_STREAM (never send low-quality video streams) or ENABLE_SIMULCAST_STREAM (always send low-quality video streams).
  • If you want to restore the default behavior after making changes, you can call this method again with mode set to AUTO_SIMULCAST_STREAM.
Note: The difference and connection between this method and enableDualStreamMode [1/2] is as follows:
  • When calling this method and setting mode to DISABLE_SIMULCAST_STREAM, it has the same effect as enableDualStreamMode [1/2](false).
  • When calling this method and setting mode to ENABLE_SIMULCAST_STREAM, it has the same effect as enableDualStreamMode [1/2](true).
  • Both methods can be called before and after joining a channel. If both methods are used, the settings in the method called later takes precedence.

Parameters

mode
The mode in which the video stream is sent. See SIMULCAST_STREAM_MODE.

Returns

  • 0: Success.
  • < 0: Failure.

setDualStreamMode [2/2]

Sets dual-stream mode configuration on the sender side.

public abstract int setDualStreamMode(
      Constants.SimulcastStreamMode mode, SimulcastStreamConfig streamConfig);

Details

Since
v4.0.1
The SDK defaults to enabling low-quality video stream adaptive mode (AUTO_SIMULCAST_STREAM) on the sender side, which means the sender does not actively send low-quality video stream. The receiving end with the role of the host can initiate a low-quality video stream request by calling setRemoteVideoStreamType, and upon receiving the request, the sending end automatically starts sending low-quality stream.
  • If you want to modify this behavior, you can call this method and set mode to DISABLE_SIMULCAST_STREAM (never send low-quality video streams) or ENABLE_SIMULCAST_STREAM (always send low-quality video streams).
  • If you want to restore the default behavior after making changes, you can call this method again with mode set to AUTO_SIMULCAST_STREAM.

The difference between this method and setDualStreamMode [1/2] is that this method can also configure the low-quality video stream, and the SDK sends the stream according to the configuration in streamConfig.

Note: The difference and connection between this method and enableDualStreamMode [2/2] is as follows:
  • When calling this method and setting mode to DISABLE_SIMULCAST_STREAM, it has the same effect as calling enableDualStreamMode [2/2] and setting enabled to false.
  • When calling this method and setting mode to ENABLE_SIMULCAST_STREAM, it has the same effect as calling enableDualStreamMode [2/2] and setting enabled to true.
  • Both methods can be called before and after joining a channel. If both methods are used, the settings in the method called later takes precedence.

Parameters

mode
The mode in which the video stream is sent. See SIMULCAST_STREAM_MODE.
streamConfig
The configuration of the low-quality video stream. See SimulcastStreamConfig.
Note: When setting mode to DISABLE_SIMULCAST_STREAM, setting streamConfig will not take effect.

Returns

  • 0: Success.
  • < 0: Failure.

setEffectPosition

Sets the playback position of an audio effect file.

public abstract int setEffectPosition(int soundId, int pos);

Details

After a successful setting, the local audio effect file starts playing at the specified position.

Attention: Call this method after playEffect.

Parameters

soundId
The audio effect ID. The ID of each audio effect file is unique.
pos
The playback position (ms) of the audio effect file.

Returns

  • 0: Success.
  • < 0: Failure.

setEarMonitoringAudioFrameParameters

Sets the format of the in-ear monitoring raw audio data.

public abstract int setEarMonitoringAudioFrameParameters(
    int sampleRate, int channel, int mode, int samplesPerCall);

Details

This method is used to set the in-ear monitoring audio data format reported by the onEarMonitoringAudioFrame callback.

Attention:
  • Before calling this method, you need to call enableInEarMonitoring [2/2], and set includeAudioFilters to EAR_MONITORING_FILTER_BUILT_IN_AUDIO_FILTERS or EAR_MONITORING_FILTER_NOISE_SUPPRESSION.
  • The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onEarMonitoringAudioFrame callback according to the sampling interval.

Parameters

sampleRate
The sample rate of the audio data reported in the onEarMonitoringAudioFrame callback, which can be set as 8,000, 16,000, 32,000, 44,100, or 48,000 Hz.
channel
The number of audio channels reported in the onEarMonitoringAudioFrame callback.
  • 1: Mono.
  • 2: Stereo.
mode
The use mode of the audio frame:
  • RAW_AUDIO_FRAME_OP_MODE_READ_ONLY(0): (Default) Read only mode. For example, when users acquire the data with the Agora SDK, then push the RTMP or RTMPS streams.
  • RAW_AUDIO_FRAME_OP_MODE_READ_WRITE(2): Read and write mode: Users read the data from AudioFrame, modify it, and then play it. For example, when users have their own audio-effect processing module and perform some voice pre-processing, such as a voice change.
samplesPerCall
The number of data samples reported in the onEarMonitoringAudioFrame callback, such as 1,024 for the Media Push.

Returns

  • 0: Success.
  • < 0: Failure.

setEnableSpeakerphone

Enables/Disables the audio route to the speakerphone.

public abstract int setEnableSpeakerphone(boolean enabled);

Details

If the default audio route of the SDK or the setting in setDefaultAudioRouteToSpeakerphone cannot meet your requirements, you can call setEnableSpeakerphone to switch the current audio route. After a successful method call, the SDK triggers the onAudioRouteChanged callback.

For the default audio route in different scenarios, see Audio Route.

This method only sets the audio route in the current channel and does not influence the default audio route. If the user leaves the current channel and joins another channel, the default audio route is used.

Attention:
  • Call this method after joining a channel.
  • If the user uses an external audio playback device such as a Bluetooth or wired headset, this method does not take effect, and the SDK plays audio through the external device. When the user uses multiple external devices, the SDK plays audio through the last connected device.

Parameters

enabled
Sets whether to enable the speakerphone or earpiece:
  • true: Enable device state monitoring. The audio route is the speakerphone.
  • false: Disable device state monitoring. The audio route is the earpiece.

Returns

  • 0: Success.
  • < 0: Failure.

setEncryptionMode

Sets the built-in encryption mode.

public abstract int setEncryptionMode(String encryptionMode);

Details

Deprecated:
Use enableEncryption instead.

The SDK supports built-in encryption schemes, AES-128-GCM is supported by default. Call this method to use other encryption modes. All users in the same channel must use the same encryption mode and secret. Refer to the information related to the AES encryption algorithm on the differences between the encryption modes.

Attention: Before calling this method, please call setEncryptionSecret to enable the built-in encryption function.

Parameters

encryptionMode
The following encryption modes:
  • "aes-128-xts": 128-bit AES encryption, XTS mode.
  • "aes-128-ecb": 128-bit AES encryption, ECB mode.
  • "aes-256-xts": 256-bit AES encryption, XTS mode.
  • "sm4-128-ecb": 128-bit SM4 encryption, ECB mode.
  • "aes-128-gcm": 128-bit AES encryption, GCM mode.
  • "aes-256-gcm": 256-bit AES encryption, GCM mode.
  • "": When this parameter is set as null, the encryption mode is set as "aes-128-gcm" by default.

Returns

  • 0: Success.
  • < 0: Failure.

setEncryptionSecret

Enables built-in encryption with an encryption password before users join a channel.

public abstract int setEncryptionSecret(String secret);

Details

Deprecated:
Use enableEncryption instead.

Before joining the channel, you need to call this method to set the secret parameter to enable the built-in encryption. All users in the same channel should use the same secret. The secret is automatically cleared once a user leaves the channel. If you do not specify the secret or secret is set as null, the built-in encryption is disabled.

Attention:
  • Do not use this method for Media Push.
  • For optimal transmission, ensure that the encrypted data size does not exceed the original data size + 16 bytes. 16 bytes is the maximum padding size for AES encryption.

Parameters

secret
The encryption password.

Returns

  • 0: Success.
  • < 0: Failure.

setExtensionProperty

Sets the properties of the extension.

public abstract int setExtensionProperty(
      String provider, String extension, String key, String value);

After enabling the extension, you can call this method to set the properties of the extension.

Call timing

Call this mehtod after calling enableExtension.

Restrictions

If you want to set properties for multiple extensions, you need to call this method multiple times.

Parameters

provider
The name of the extension provider.
extension
The name of the extension.
key
The key of the extension.
value
The value of the extension key.

Returns

  • 0: Success.
  • < 0: Failure.

setExtensionProviderProperty

Sets the properties of the extension provider.

public abstract int setExtensionProviderProperty(String provider, String key, String value);

You can call this method to set the attributes of the extension provider and initialize the relevant parameters according to the type of the provider.

Call timing

Call this method before enableExtension and after registerExtension.

Restrictions

If you want to set the properties of the extension provider for multiple extensions, you need to call this method multiple times.

Parameters

provider
The name of the extension provider.
key
The key of the extension.
value
The value of the extension key.

Returns

  • 0: Success.
  • < 0: Failure.

setExternalAudioSink

Sets the external audio sink.

public abstract int setExternalAudioSink(boolean enabled, int sampleRate, int channels);

Details

This method applies to scenarios where you want to use external audio data for playback. After you set the external audio sink, you can call pullPlaybackAudioFrame [1/2] to pull remote audio frames. The app can process the remote audio and play it with the audio effects that you want.

Parameters

enabled
Whether to enable or disable the external audio sink:
  • true: Enables the external audio sink.
  • false: (Default) Disables the external audio sink.
sampleRate

The sample rate (Hz) of the external audio sink, which can be set as 16000, 32000, 44100, or 48000.

channels
The number of audio channels of the external audio sink:
  • 1: Mono.
  • 2: Stereo.

Returns

  • 0: Success.
  • < 0: Failure.

setExternalAudioSource [1/2]

Sets the external audio source.

public abstract int setExternalAudioSource(boolean enabled, int sampleRate, int channels);

Details

Call this method before calling joinChannel [1/2] and startPreview [1/2].

Parameters

enabled
  • true: Enable the external audio source.
  • false: (Default) Disable the external audio source.
sampleRate
The sample rate (Hz) of the external audio source, which can be set as 8000, 16000, 32000, 44100, or 48000.
channels
The number of audio channels of the external audio source:
  • 1: Mono.
  • 2: Stereo.

Returns

  • 0: Success.
  • < 0: Failure.

setExternalAudioSource [2/2]

Sets the external audio source parameters.

public abstract int setExternalAudioSource(boolean enabled, int sampleRate, int channels, boolean localPlayback, boolean publish);

Details

Deprecated:
This method is deprecated, use createCustomAudioTrack instead.
Attention: Call this method before joining a channel.

Parameters

enabled
Whether to enable the external audio source:
  • true: Enable the external audio source.
  • false: (Default) Disable the external audio source.
sampleRate
The sample rate (Hz) of the external audio source which can be set as 8000, 16000, 32000, 44100, or 48000.
channels
The number of channels of the external audio source, which can be set as 1 (Mono) or 2 (Stereo).
localPlayback
Whether to play the external audio source:
  • true: Play the external audio source.
  • false: (Default) Do not play the external source.
publish
Whether to publish audio to the remote users:
  • true: (Default) Publish audio to the remote users.
  • false: Do not publish audio to the remote users.

Returns

  • 0: Success.
  • < 0: Failure.

setExternalVideoSource

Configures the external video source.

public abstract int setExternalVideoSource(
    boolean enable, boolean useTexture, Constants.ExternalVideoSourceType sourceType);

Details

Attention: Call this method before joining a channel.

Parameters

enable
Whether to use the external video source:
  • true: Use the external video source. The SDK prepares to accept the external video frame.
  • false: (Default) Do not use the external video source.
useTexture
Whether to use the external video frame in the Texture format.
  • true: Use the external video frame in the Texture format.
  • false: (Default) Do not use the external video frame in the Texture format.
sourceType
Whether the external video frame is encoded. See ExternalVideoSourceType.

Returns

  • 0: Success.
  • < 0: Failure.

setHeadphoneEQParameters

Sets the low- and high-frequency parameters of the headphone equalizer.

public abstract int setHeadphoneEQParameters(int lowGain, int highGain);

Details

Since
v4.1.0

In a spatial audio effect scenario, if the preset headphone equalization effect is not achieved after calling the setHeadphoneEQPreset method, you can further adjust the headphone equalization effect by calling this method.

Parameters

lowGain
The low-frequency parameters of the headphone equalizer. The value range is [-10,10]. The larger the value, the deeper the sound.
highGain
The high-frequency parameters of the headphone equalizer. The value range is [-10,10]. The larger the value, the sharper the sound.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).

setHeadphoneEQPreset

Sets the preset headphone equalization effect.

public abstract int setHeadphoneEQPreset(int preset);

Details

Since
v4.0.1

This method is mainly used in spatial audio effect scenarios. You can select the preset headphone equalizer to listen to the audio to achieve the expected audio experience.

Note: If the headphones you use already have a good equalization effect, you may not get a significant improvement when you call this method, and could even diminish the experience.

Parameters

preset
The preset headphone equalization effect. See HEADPHONE_EQUALIZER_PRESET.

Returns

  • 0: Success.
  • < 0: Failure.
    • -1: A general error occurs (no specified reason).

setInEarMonitoringVolume

Sets the volume of the in-ear monitor.

public abstract int setInEarMonitoringVolume(int volume);

Call timing

This method can be called either before or after joining the channel.

Restrictions

None.

Parameters

volume
The volume of the user. The value range is [0,400].
  • 0: Mute.
  • 100: (Default) The original volume.
  • 400: Four times the original volume (amplifying the audio signals by four times).

Returns

  • 0: Success.
  • < 0: Failure.
    • -2: Invalid parameter settings, such as in-ear monitoring volume exceeding the valid range (< 0 or > 400).

setLocalRenderMode [1/2]

Sets the local video display mode.

public abstract int setLocalRenderMode(int renderMode);

Details

Deprecated:
This method is deprecated. Use setLocalRenderMode [2/2] instead.

Call this method to set the local video display mode. This method can be called multiple times during a call to change the display mode.

Parameters

renderMode
The local video display mode.
  • RENDER_MODE_HIDDEN(1): Hidden mode. Uniformly scale the video until it fills the visible boundaries (cropped). One dimension of the video may have clipped contents.
  • RENDER_MODE_FIT(2): Fit mode. Uniformly scale the video until one of its dimension fits the boundary (zoomed to fit). Areas that are not filled due to the disparity in the aspect ratio are filled with black.
  • RENDER_MODE_ADAPTIVE(3): This mode is deprecated.

Returns

  • 0: Success.
  • < 0: Failure.

setLocalRenderMode [2/2]

Updates the display mode of the local video view.

public abstract int setLocalRenderMode(int renderMode, int mirrorMode);

Details

After initializing the local video view, you can call this method to update its rendering and mirror modes. It affects only the video view that the local user sees, not the published local video stream.

Attention:
  • Ensure that you have called the setupLocalVideo method to initialize the local video view before calling this method.
  • During a call, you can call this method as many times as necessary to update the display mode of the local video view.

Parameters

renderMode
The local video display mode.
  • RENDER_MODE_HIDDEN(1): Hidden mode. Uniformly scale the video until it fills the visible boundaries (cropped). One dimension of the video may have clipped contents.
  • RENDER_MODE_FIT(2): Fit mode. Uniformly scale the video until one of its dimension fits the boundary (zoomed to fit). Areas that are not filled due to the disparity in the aspect ratio are filled with black.
  • RENDER_MODE_ADAPTIVE(3): This mode is deprecated.
mirrorMode
For the local user:
  • VIDEO_MIRROR_MODE_AUTO(0): The SDK determines whether to enable the mirror mode. If you use a front camera, the SDK enables the mirror mode by default; if you use a rear camera, the SDK disables the mirror mode by default.
  • VIDEO_MIRROR_MODE_ENABLED(1): Enable the mirroring mode of the local view.
  • VIDEO_MIRROR_MODE_DISABLED(2): Disable the mirroring mode of the local view.
Attention: If you use a front camera, the SDK enables the mirror mode by default; if you use a rear camera, the SDK disables the mirror mode by default.

Returns

  • 0: Success.
  • < 0: Failure.

setLocalVideoMirrorMode

Sets the local video mirror mode.

public abstract int setLocalVideoMirrorMode(int mode);

Details

Deprecated:
This method is deprecated.
Use setupLocalVideo or setLocalRenderMode [2/2] instead.

Parameters

mode
  • VIDEO_MIRROR_MODE_AUTO(0): The SDK determines whether to enable the mirror mode. If you use a front camera, the SDK enables the mirror mode by default; if you use a rear camera, the SDK disables the mirror mode by default.
  • VIDEO_MIRROR_MODE_ENABLED(1): Enable the mirroring mode of the local view.
  • VIDEO_MIRROR_MODE_DISABLED(2): Disable the mirroring mode of the local view.

Returns

  • 0: Success.
  • < 0: Failure.

setLocalVoiceEqualization

Sets the local voice equalization effect.

public abstract int setLocalVoiceEqualization(
      Constants.AUDIO_EQUALIZATION_BAND_FREQUENCY bandFrequency, int bandGain);

Details

Attention: You can call this method either before or after joining a channel.

Parameters

bandFrequency
The band frequency. The value ranges between 0 and 9; representing the respective 10-band center frequencies of the voice effects, including 31, 62, 125, 250, 500, 1k, 2k, 4k, 8k, and 16k Hz. See AUDIO_EQUALIZATION_BAND_FREQUENCY.
bandGain
The gain of each band in dB. The value ranges between -15 and 15. The default value is 0.

Returns

  • 0: Success.
  • < 0: Failure.

setLocalVoicePitch

Changes the voice pitch of the local speaker.

public abstract int setLocalVoicePitch(double pitch);

Details

Attention: You can call this method either before or after joining a channel.

Parameters

pitch
The local voice pitch. The value range is [0.5,2.0]. The lower the value, the lower the pitch. The default value is 1.0 (no change to the pitch).

Returns

  • 0: Success.
  • < 0: Failure.

setLocalVoiceReverb

Sets the local voice reverberation.

public abstract int setLocalVoiceReverb(Constants.AUDIO_REVERB_TYPE reverbKey, int value);

Details

The SDK provides an easier-to-use method, setAudioEffectPreset, to directly implement preset reverb effects for such as pop, R&B, and KTV.

Note: You can call this method either before or after joining a channel.

Parameters

reverbKey
The reverberation key. Agora provides five reverberation keys, see AUDIO_REVERB_TYPE.
value
The value of the reverberation key.

Returns

  • 0: Success.
  • < 0: Failure.

setLogFile

Sets the log file.

public abstract int setLogFile(String filePath);

Details

Deprecated:
Use the mLogConfig parameter in create [2/2] method instead.

Specifies an SDK output log file. The log file records all log data for the SDK’s operation. Ensure that the directory for the log file exists and is writable.

Note:

Ensure that you call create [2/2] immediately after calling the RtcEngine method, or the output log may not be complete.

Parameters

filePath
The complete path of the log files. These log files are encoded in UTF-8.

Returns

  • 0: Success.
  • < 0: Failure.

setLogFileSize

Sets the log file size.

public abstract int setLogFileSize(long fileSizeInKBytes);

Details

Deprecated:
Use the logConfig parameter in create [2/2] instead.

By default, the SDK generates five SDK log files and five API call log files with the following rules:

  • The SDK log files are: agorasdk.log, agorasdk.1.log, agorasdk.2.log, agorasdk.3.log, and agorasdk.4.log.
  • The API call log files are: agoraapi.log, agoraapi.1.log, agoraapi.2.log, agoraapi.3.log, and agoraapi.4.log.
  • The default size of each SDK log file and API log file is 2,048 KB. These log files are encoded in UTF-8.
  • The SDK writes the latest logs in agorasdk.log or agoraapi.log.
  • When agorasdk.log is full, the SDK processes the log files in the following order:
    1. Delete the agorasdk.4.log file (if any).
    2. Rename agorasdk.3.log to agorasdk.4.log.
    3. Rename agorasdk.2.log to agorasdk.3.log.
    4. Rename agorasdk.1.log to agorasdk.2.log.
    5. Create a new agorasdk.log file.
  • The overwrite rules for the agoraapi.log file are the same as for agorasdk.log.
Note:

This method is used to set the size of the agorasdk.log file only and does not effect the agoraapi.log file.

Parameters

fileSizeInKBytes
The size (KB) of an agorasdk.log file. The value range is [128,20480]. The default value is 2,048 KB. If you set fileSizeInKByte smaller than 128 KB, the SDK automatically adjusts it to 128 KB; if you set fileSizeInKByte greater than 20,480 KB, the SDK automatically adjusts it to 20,480 KB.

Returns

  • 0: Success.
  • < 0: Failure.

setLogFilter

Sets the log output level of the SDK.

public abstract int setLogFilter(int filter);

Details

Deprecated:
Use logConfig in create [2/2] instead.

This method sets the output log level of the SDK. You can use one or a combination of the log filter levels. The log level follows the sequence of LOG_FILTER_OFF, LOG_FILTER_CRITICAL, LOG_FILTER_ERROR, LOG_FILTER_WARN, LOG_FILTER_INFO, and LOG_FILTER_DEBUG. Choose a level to see the logs preceding that level.

If, for example, you set the log level to LOG_FILTER_WARN, you see the logs within levels LOG_FILTER_CRITICAL, LOG_FILTER_ERROR and LOG_FILTER_WARN.

Parameters

filter
The output log level of the SDK.
  • LOG_FILTER_OFF(0): Do not output any log information.
  • LOG_FILTER_DEBUG(0x080f): Output all log information. Set your log filter as DEBUG if you want to get the most complete log file.
  • LOG_FILTER_INFO(0x0f): Output LOG_FILTER_CRITICAL, LOG_FILTER_ERROR, LOG_FILTER_WARN, and LOG_FILTER_INFO level log information. Agora recommends that you set the log level to this level.
  • LOG_FILTER_WARN(0x0e): Output LOG_FILTER_CRITICAL, LOG_FILTER_ERROR and LOG_FILTER_WARN level log information.
  • LOG_FILTER_ERROR(0x0c): Output LOG_FILTER_CRITICAL and LOG_FILTER_ERROR level log information.
  • LOG_FILTER_CRITICAL(0x08): Output LOG_FILTER_CRITICAL level log information.

Returns

  • 0: Success.
  • < 0: Failure.

setLogLevel

Sets the output log level of the SDK.

public abstract int setLogLevel(int level);

Details

Deprecated:
This method is deprecated. Use RtcEngineConfig instead to set the log output level.

Choose a level to see the logs preceding that level.

Parameters

level
The log level: LogLevel.

Returns

  • 0: Success.
  • < 0: Failure.

setLowlightEnhanceOptions [1/2]

Sets low-light enhancement.

public abstract int setLowlightEnhanceOptions(boolean enabled, LowLightEnhanceOptions options);

Details

The low-light enhancement feature can adaptively adjust the brightness value of the video captured in situations with low or uneven lighting, such as backlit, cloudy, or dark scenes. It restores or highlights the image details and improves the overall visual effect of the video.

You can call this method to enable the color enhancement feature and set the options of the color enhancement effect.

Attention:
  • Call this method after calling enableVideo.
  • Dark light enhancement has certain requirements for equipment performance. The low-light enhancement feature has certain performance requirements on devices. If your device overheats after you enable low-light enhancement, Agora recommends modifying the low-light enhancement options to a less performance-consuming level or disabling low-light enhancement entirely.
  • Both this method and setExtensionProperty can turn on low-light enhancement:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable low-light enhancement:
  • true: Enable low-light enhancement.
  • false: (Default) Disable low-light enhancement.
options
The low-light enhancement options. See LowlightEnhanceOptions.

Returns

  • 0: Success.
  • < 0: Failure.

setLowlightEnhanceOptions [2/2]

Sets low light enhance options and specifies the media source.

public abstract int setLowlightEnhanceOptions(
      boolean enabled, LowLightEnhanceOptions options, Constants.MediaSourceType sourceType);

Details

The low-light enhancement feature can adaptively adjust the brightness value of the video captured in situations with low or uneven lighting, such as backlit, cloudy, or dark scenes. It restores or highlights the image details and improves the overall visual effect of the video.

This method and setLowlightEnhanceOptions [1/2] both set low light enhance options, but this method allows you to specify the media source to which the low light enhance options are applied.

Attention:
  • Call this method after calling enableVideo.
  • Dark light enhancement has certain requirements for equipment performance. The low-light enhancement feature has certain performance requirements on devices. If your device overheats after you enable low-light enhancement, Agora recommends modifying the low-light enhancement options to a less performance-consuming level or disabling low-light enhancement entirely.
  • Both this method and setExtensionProperty can turn on low-light enhancement:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable low-light enhancement:
  • true: Enable low-light enhancement.
  • false: (Default) Disable low-light enhancement.
options
The low-light enhancement options. See LowlightEnhanceOptions.
sourceType
The media source type to which the effect is applied. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.

setMixedAudioFrameParameters

Sets the audio data format reported by onMixedAudioFrame.

public abstract int setMixedAudioFrameParameters(int sampleRate, int channel, int samplesPerCall);

Parameters

sampleRate

The sample rate (Hz) of the audio data, which can be set as 8000, 16000, 32000, 44100, or 48000.

channel

The number of channels of the audio data, which can be set as 1(Mono) or 2(Stereo).

samplesPerCall

Sets the number of samples. In Media Push scenarios, set it as 1024.

Note:

The SDK triggers the onMixedAudioFrame callback according to the sample interval. Sampleinterval (sec) = samplePerCall/(sampleRate × channel) Ensure that the value of sample interval more than or equal to 0.01.

Returns

  • 0: Success.
  • < 0: Failure.

setParameters

Provides technical preview functionalities or special customizations by configuring the SDK with JSON options.

public abstract int setParameters(String parameters);

Parameters

parameters
Pointer to the set parameters in a JSON string.

Returns

  • 0: Success.
  • < 0: Failure.

setPlaybackAudioFrameBeforeMixingParameters

Sets the audio data format reported by onPlaybackAudioFrameBeforeMixing.

public abstract int setPlaybackAudioFrameBeforeMixingParameters(int sampleRate, int channel);

Parameters

sampleRate

The sample rate (Hz) of the audio data, which can be set as 8000, 16000, 32000, 44100, or 48000.

channel

The number of channels of the audio data, which can be set as 1(Mono) or 2(Stereo).

Returns

  • 0: Success.
  • < 0: Failure.

setPlaybackAudioFrameParameters

Sets the audio data format for playback.

public abstract int setPlaybackAudioFrameParameters(
      int sampleRate, int channel, int mode, int samplesPerCall);

Details

Sets the data format for the onPlaybackAudioFrame callback.

Attention:
  • Ensure that you call this method before joining a channel.
  • The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onPlaybackAudioFrame callback according to the sampling interval.

Parameters

sampleRate
The sample rate returned in the onPlaybackAudioFrame callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
channel
The number of channels returned in the onPlaybackAudioFrame callback:
  • 1: Mono.
  • 2: Stereo.
mode
The use mode of the audio frame:
  • RAW_AUDIO_FRAME_OP_MODE_READ_ONLY(0): (Default) Read only mode. For example, when users acquire the data with the Agora SDK, then push the RTMP or RTMPS streams.
  • RAW_AUDIO_FRAME_OP_MODE_READ_WRITE(2): Read and write mode: Users read the data from AudioFrame, modify it, and then play it. For example, when users have their own audio-effect processing module and perform some voice pre-processing, such as a voice change.
samplesPerCall
The number of data samples returned in the onPlaybackAudioFrame callback, such as 1024 for the Media Push.

Returns

  • 0: Success.
  • < 0: Failure.

setRecordingAudioFrameParameters

Sets the format of the captured raw audio data.

public abstract int setRecordingAudioFrameParameters(
      int sampleRate, int channel, int mode, int samplesPerCall);

Details

Sets the audio format for the onRecordAudioFrame callback.

Attention:
  • Ensure that you call this method before joining a channel.
  • The SDK calculates the sampling interval based on the samplesPerCall, sampleRate and channel parameters set in this method.Sample interval (sec) = samplePerCall/(sampleRate × channel). Ensure that the sample interval ≥ 0.01 (s). The SDK triggers the onRecordAudioFrame callback according to the sampling interval.

Parameters

sampleRate
The sample rate returned in the onRecordAudioFrame callback, which can be set as 8000, 16000, 32000, 44100, or 48000 Hz.
channel
The number of channels returned in the onRecordAudioFrame callback:
  • 1: Mono.
  • 2: Stereo.
mode
The use mode of the audio frame:
  • RAW_AUDIO_FRAME_OP_MODE_READ_ONLY(0): (Default) Read only mode. For example, when users acquire the data with the Agora SDK, then push the RTMP or RTMPS streams.
  • RAW_AUDIO_FRAME_OP_MODE_READ_WRITE(2): Read and write mode: Users read the data from AudioFrame, modify it, and then play it. For example, when users have their own audio-effect processing module and perform some voice pre-processing, such as a voice change.
samplesPerCall
The number of data samples returned in the onRecordAudioFrame callback, such as 1024 for the Media Push.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteDefaultVideoStreamType

Sets the default video stream type to subscribe to.

public abstract int setRemoteDefaultVideoStreamType(int streamType);

Details

The SDK defaults to enabling low-quality video stream adaptive mode (AUTO_SIMULCAST_STREAM) on the sending end, which means the sender does not actively send low-quality video stream. The receiver with the role of the host can initiate a low-quality video stream request by calling this method, and upon receiving the request, the sending end automatically starts sending the low-quality video stream.

The SDK will dynamically adjust the size of the corresponding video stream based on the size of the video window to save bandwidth and computing resources. The default aspect ratio of the low-quality video stream is the same as that of the high-quality video stream. According to the current aspect ratio of the high-quality video stream, the system will automatically allocate the resolution, frame rate, and bitrate of the low-quality video stream.

Attention:
  • Call this method before joining a channel. The SDK does not support changing the default subscribed video stream type after joining a channel.
  • If you call both this method and setRemoteVideoStreamType, the setting of setRemoteVideoStreamType takes effect.

Parameters

streamType
The default video-stream type:
  • VIDEO_STREAM_HIGH(0): High-quality stream, that is, a high-resolution and high-bitrate video stream.
  • VIDEO_STREAM_LOW(1): Low-quality stream, that is, a low-resolution and low-bitrate video stream.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteRenderMode [1/2]

Sets the video display mode of a specified remote user.

public abstract int setRemoteRenderMode(int userId, int renderMode);

Details

Deprecated:
This method is deprecated. Use setRemoteRenderMode [2/2] instead.

Call this method to set the video display mode of a specified remote user. This method can be called multiple times during a call to change the display mode.

Parameters

userId
The user ID of the remote user.
renderMode
The rendering mode of the remote user view.
  • RENDER_MODE_HIDDEN(1): Hidden mode. Uniformly scale the video until it fills the visible boundaries (cropped). One dimension of the video may have clipped contents.
  • RENDER_MODE_FIT(2): Fit mode. Uniformly scale the video until one of its dimension fits the boundary (zoomed to fit). Areas that are not filled due to the disparity in the aspect ratio are filled with black.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteRenderMode [2/2]

Updates the display mode of the video view of a remote user.

public abstract int setRemoteRenderMode(int userId, int renderMode, int mirrorMode);

Details

After initializing the video view of a remote user, you can call this method to update its rendering and mirror modes. This method affects only the video view that the local user sees.

Attention:
  • Call this method after initializing the remote view by calling the setupRemoteVideo method.
  • During a call, you can call this method as many times as necessary to update the display mode of the video view of a remote user.

Parameters

userId
The user ID of the remote user.
renderMode
The rendering mode of the remote user view.
  • RENDER_MODE_HIDDEN(1): Hidden mode. Uniformly scale the video until it fills the visible boundaries (cropped). One dimension of the video may have clipped contents.
  • RENDER_MODE_FIT(2): Fit mode. Uniformly scale the video until one of its dimension fits the boundary (zoomed to fit). Areas that are not filled due to the disparity in the aspect ratio are filled with black.
  • RENDER_MODE_ADAPTIVE(3): This mode is deprecated.
mirrorMode
The mirror mode of the remote user view.
  • VIDEO_MIRROR_MODE_AUTO(0): The SDK determines whether to enable the mirror mode. If you use a front camera, the SDK enables the mirror mode by default; if you use a rear camera, the SDK disables the mirror mode by default.
  • VIDEO_MIRROR_MODE_ENABLED(1): Enable the mirroring mode of the local view.
  • VIDEO_MIRROR_MODE_DISABLED(2): Disable the mirroring mode of the local view.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteSubscribeFallbackOption

Sets the fallback option for the subscribed video stream based on the network conditions.

public abstract int setRemoteSubscribeFallbackOption(int option);

Details

An unstable network affects the audio and video quality in a video call or interactive live video streaming. If option is set as STREAM_FALLBACK_OPTION_VIDEO_STREAM_LOW or STREAM_FALLBACK_OPTION_AUDIO_ONLY, the SDK automatically switches the video from a high-quality stream to a low-quality stream or disables the video when the downlink network conditions cannot support both audio and video to guarantee the quality of the audio. Meanwhile, the SDK continuously monitors network quality and resumes subscribing to audio and video streams when the network quality improves.

When the subscribed video stream falls back to an audio-only stream, or recovers from an audio-only stream to an audio-video stream, the SDK triggers the onRemoteSubscribeFallbackToAudioOnly callback.

Parameters

option
Fallback options for the subscribed stream.
  • STREAM_FALLBACK_OPTION_DISABLED(0): No fallback processing is performed on audio and video streams, and the quality of the audio and video streams cannot be guaranteed.
  • STREAM_FALLBACK_OPTION_VIDEO_STREAM_LOW(1): (Default) Under poor downlink network conditions, the remote video stream, to which you subscribe, falls back to the low-quality (low resolution and low bitrate) video stream.
  • STREAM_FALLBACK_OPTION_AUDIO_ONLY(2): When the network conditions are poor, try to receive the low-quality video stream first. If the video cannot be displayed due to extremely poor network environment, then fall back to receiving audio-only stream.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteUserSpatialAudioParams

Sets the spatial audio effect parameters of the remote user.

public abstract int setRemoteUserSpatialAudioParams(int uid, SpatialAudioParams params);

Details

Call this method after enableSpatialAudio. After successfully setting the spatial audio effect parameters of the remote user, the local user can hear the remote user with a sense of space.

Parameters

uid
The user ID. This parameter must be the same as the user ID passed in when the user joined the channel.
params
The spatial audio parameters. See SpatialAudioParams.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteVideoStreamType

Sets the video stream type to subscribe to.

public abstract int setRemoteVideoStreamType(int uid, int streamType);

Details

The SDK defaults to enabling low-quality video stream adaptive mode (AUTO_SIMULCAST_STREAM) on the sending end, which means the sender does not actively send low-quality video stream. The receiver with the role of the host can initiate a low-quality video stream request by calling this method, and upon receiving the request, the sending end automatically starts sending the low-quality video stream.

The SDK will dynamically adjust the size of the corresponding video stream based on the size of the video window to save bandwidth and computing resources. The default aspect ratio of the low-quality video stream is the same as that of the high-quality video stream. According to the current aspect ratio of the high-quality video stream, the system will automatically allocate the resolution, frame rate, and bitrate of the low-quality video stream.

Attention:
  • You can call this method either before or after joining a channel.
  • If the publisher has already called setDualStreamMode [2/2] and set mode to DISABLE_SIMULCAST_STREAM (never send low-quality video stream), calling this method will not take effect, you should call setDualStreamMode [2/2] again on the sending end and adjust the settings.
  • Calling this method on the receiving end of the audience role will not take effect.
  • If you call both setRemoteVideoStreamType and setRemoteDefaultVideoStreamType, the settings in setRemoteVideoStreamType take effect.

Parameters

uid
The user ID.
streamType
The video stream type:
  • 0: High-quality video stream.
  • 1: Low-quality video stream.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteVideoSubscriptionOptions

Options for subscribing to remote video streams.

public abstract int setRemoteVideoSubscriptionOptions(int uid, VideoSubscriptionOptions options);

Details

When a remote user has enabled dual-stream mode, you can call this method to choose the option for subscribing to the video streams sent by the remote user.

  • If you only register one IVideoFrameObserver object, the SDK subscribes to the raw video data and encoded video data by default (the effect is equivalent to setting encodedFrameOnly to false).
  • If you only register one IVideoEncodedFrameObserver object, the SDK only subscribes to the encoded video data by default (the effect is equivalent to setting encodedFrameOnly to true).
  • If you register one IVideoFrameObserver object and one IVideoEncodedFrameObserver object successively, the SDK subscribes to the encoded video data by default (the effect is equivalent to setting encodedFrameOnly to false).
  • If you call this method first with the options parameter set, and then register one IVideoFrameObserver or IVideoEncodedFrameObserver object, you need to call this method again and set the options parameter as described in the above two items to get the desired results.
Note: Agora recommends the following steps:
  1. Set autoSubscribeVideo to false when calling joinChannel [2/2] to join a channel.
  2. Call this method after receiving the onUserJoined callback to set the subscription options for the specified remote user's video stream.
  3. Call the muteRemoteVideoStream method to resume subscribing to the video stream of the specified remote user. If you set encodedFrameOnly to true in the previous step, the SDK triggers the onEncodedVideoFrameReceived callback locally to report the received encoded video frame information.

Parameters

uid
The user ID of the remote user.
options
The video subscription options. See VideoSubscriptionOptions.

Returns

  • 0: Success.
  • < 0: Failure.

setRemoteVoicePosition

Sets the 2D position (the position on the horizontal plane) of the remote user's voice.

public abstract int setRemoteVoicePosition(int uid, double pan, double gain);

Details

This method sets the 2D position and volume of a remote user, so that the local user can easily hear and identify the remote user's position.

When the local user calls this method to set the voice position of a remote user, the voice difference between the left and right channels allows the local user to track the real-time position of the remote user, creating a sense of space. This method applies to massive multiplayer online games, such as Battle Royale games.

Attention:
  • For this method to work, enable stereo panning for remote users by calling the enableSoundPositionIndication method before joining a channel.
  • For the best voice positioning, Agora recommends using a wired headset.
  • Call this method after joining a channel.

Parameters

uid
The user ID of the remote user.
pan
The voice position of the remote user. The value ranges from -1.0 to 1.0:
  • 0.0: (Default) The remote voice comes from the front.
  • -1.0: The remote voice comes from the left.
  • 1.0: The remote voice comes from the right.
gain
The volume of the remote user. The value ranges from 0.0 to 100.0. The default value is 100.0 (the original volume of the remote user). The smaller the value, the lower the volume.

Returns

  • 0: Success.
  • < 0: Failure.

setRouteInCommunicationMode

Selects the audio playback route in communication audio mode.

public abstract int setRouteInCommunicationMode(int route);

Details

Since
v4.2.2

This method is used to switch the audio route from Bluetooth headphones to earpiece, wired headphones or speakers in communication audio mode (). After the method is called successfully, the SDK will trigger the onAudioRouteChanged callback to report the modified route.

Attention: Using this method and the setEnableSpeakerphone method at the same time may cause conflicts. Agora recommends that you use the setRouteInCommunicationMode method alone.

Parameters

route
The audio playback route you want to use:
  • -1: The default audio route.
  • 0: Headphones with microphone.
  • 1: Handset.
  • 2: Headphones without microphone.
  • 3: Device's built-in speaker.
  • 4: (Not supported yet) External speakers.
  • 5: Bluetooth headphones.
  • 6: USB device.

Returns

Without practical meaning.

setSubscribeAudioBlocklist

Set the blocklist of subscriptions for audio streams.

public abstract int setSubscribeAudioBlocklist(int[] uidList);

Details

You can call this method to specify the audio streams of a user that you do not want to subscribe to.

Attention:
  • You can call this method either before or after joining a channel.
  • The blocklist is not affected by the setting in muteRemoteAudioStream,muteAllRemoteAudioStreams, and autoSubscribeAudio in ChannelMediaOptions.
  • Once the blocklist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
  • If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.

Parameters

uidList

The user ID list of users that you do not want to subscribe to.

If you want to specify the audio streams of a user that you do not want to subscribe to, add the user ID in this list. If you want to remove a user from the blocklist, you need to call the setSubscribeAudioBlocklist method to update the user ID list; this means you only add the uid of users that you do not want to subscribe to in the new user ID list.

Returns

  • 0: Success.
  • < 0: Failure.

setSubscribeAudioAllowlist

Sets the allowlist of subscriptions for audio streams.

public abstract int setSubscribeAudioAllowlist(int[] uidList);

Details

You can call this method to specify the audio streams of a user that you want to subscribe to.

Note:
  • You can call this method either before or after joining a channel.
  • The allowlist is not affected by the setting in muteRemoteAudioStream, muteAllRemoteAudioStreams and autoSubscribeAudio in ChannelMediaOptions.
  • Once the allowlist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
  • If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.

Parameters

uidList

The user ID list of users that you want to subscribe to.

If you want to specify the audio streams of a user for subscription, add the user ID in this list. If you want to remove a user from the allowlist, you need to call the setSubscribeAudioAllowlist method to update the user ID list; this means you only add the uid of users that you want to subscribe to in the new user ID list.

Returns

  • 0: Success.
  • < 0: Failure.

setSubscribeVideoBlocklist

Set the blocklist of subscriptions for video streams.

public abstract int setSubscribeVideoBlocklist(int[] uidList);

Details

You can call this method to specify the video streams of a user that you do not want to subscribe to.

Note:
  • You can call this method either before or after joining a channel.
  • The blocklist is not affected by the setting in muteRemoteVideoStream, muteAllRemoteVideoStreams and autoSubscribeAudio in ChannelMediaOptions.
  • Once the blocklist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
  • If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.

Parameters

uidList

The user ID list of users that you do not want to subscribe to.

If you want to specify the video streams of a user that you do not want to subscribe to, add the user ID of that user in this list. If you want to remove a user from the blocklist, you need to call the setSubscribeVideoBlocklist method to update the user ID list; this means you only add the uid of users that you do not want to subscribe to in the new user ID list.

Returns

  • 0: Success.
  • < 0: Failure.

setSubscribeVideoAllowlist

Set the allowlist of subscriptions for video streams.

public abstract int setSubscribeVideoAllowlist(int[] uidList);

Details

You can call this method to specify the video streams of a user that you want to subscribe to.

Note:
  • You can call this method either before or after joining a channel.
  • The allowlist is not affected by the setting in muteRemoteVideoStream, muteAllRemoteVideoStreams and autoSubscribeAudio in ChannelMediaOptions.
  • Once the allowlist of subscriptions is set, it is effective even if you leave the current channel and rejoin the channel.
  • If a user is added in the allowlist and blocklist at the same time, only the blocklist takes effect.

Parameters

uidList

The user ID list of users that you want to subscribe to.

If you want to specify the video streams of a user for subscription, add the user ID of that user in this list. If you want to remove a user from the allowlist, you need to call the setSubscribeVideoAllowlist method to update the user ID list; this means you only add the uid of users that you want to subscribe to in the new user ID list.

Returns

  • 0: Success.
  • < 0: Failure.

setupLocalVideo

Initializes the local video view.

public abstract int setupLocalVideo(VideoCanvas local);

Details

This method initializes the video view of a local stream on the local device. It affects only the video view that the local user sees, not the published local video stream. Call this method to bind the local video stream to a video view (view) and to set the rendering and mirror modes of the video view.

After initialization, call this method to set the local video and then join the channel. The local video still binds to the view after you leave the channel. To unbind the local video from the view, set the view parameter as NULL.

In real-time interactive scenarios, if you need to simultaneously view multiple preview frames in the local video preview, and each frame is at a different observation position along the video link, you can repeatedly call this method to set different views and set different observation positions for each view. For example, by setting the video source to the camera and then configuring two views with position setting to VIDEO_MODULE_POSITION_POST_CAPTURER_ORIGIN and VIDEO_MODULE_POSITION_POST_CAPTURER, you can simultaneously preview the raw, unprocessed video frame and the video frame that has undergone preprocessing (image enhancement effects, virtual background, watermark) in the local video preview.

Attention:
  • You can call this method either before or after joining a channel.
  • To update the rendering or mirror mode of the local video view during a call, use the setLocalRenderMode [2/2] method.

Parameters

local
The local video view and settings. See VideoCanvas.

Returns

  • 0: Success.
  • < 0: Failure.

setupRemoteVideo

Initializes the video view of a remote user.

public abstract int setupRemoteVideo(VideoCanvas remote);

Details

This method initializes the video view of a remote stream on the local device. It affects only the video view that the local user sees. Call this method to bind the remote video stream to a video view and to set the rendering and mirror modes of the video view.

You need to specify the ID of the remote user in this method. If the remote user ID is unknown to the application, set it after the app receives the onUserJoined callback.

To unbind the remote user from the view, set the view parameter to NULL.

Once the remote user leaves the channel, the SDK unbinds the remote user.

In the scenarios of custom layout for mixed videos on the mobile end, you can call this method and set a separate view for rendering each sub-video stream of the mixed video stream.

Attention:
  • To update the rendering or mirror mode of the remote video view during a call, use the setRemoteRenderMode [2/2] method.
  • If you use the Agora recording function, the recording client joins the channel as a placeholder client, triggering the onUserJoined callback. Do not bind the placeholder client to the app view because the placeholder client does not send any video streams. If your app does not recognize the placeholder client, bind the remote user to the view when the SDK triggers the onFirstRemoteVideoDecoded callback.

Parameters

remote

The remote video view and settings. See VideoCanvas.

Returns

  • 0: Success.
  • < 0: Failure.

setVideoDenoiserOptions [1/2]

Sets video noise reduction.

public abstract int setVideoDenoiserOptions(boolean enabled, VideoDenoiserOptions options);

Details

Underlit environments and low-end video capture devices can cause video images to contain significant noise, which affects video quality. In real-time interactive scenarios, video noise also consumes bitstream resources and reduces encoding efficiency during encoding.

You can call this method to enable the video noise reduction feature and set the options of the video noise reduction effect.

Attention:
  • Call this method after calling enableVideo.
  • Video noise reduction has certain requirements for equipment performance. If your device overheats after you enable video noise reduction, Agora recommends modifying the video noise reduction options to a less performance-consuming level or disabling video noise reduction entirely.
  • Both this method and setExtensionProperty can turn on video noise reduction function:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable video noise reduction:
  • true: Enable video noise reduction.
  • false: (Default) Disable video noise reduction.
options
The video noise reduction options. See VideoDenoiserOptions.

Returns

  • 0: Success.
  • < 0: Failure.

setVideoDenoiserOptions [2/2]

Sets video noise reduction and specifies the media source.

public abstract int setVideoDenoiserOptions(
      boolean enabled, VideoDenoiserOptions options, Constants.MediaSourceType sourceType);

Details

Underlit environments and low-end video capture devices can cause video images to contain significant noise, which affects video quality. In real-time interactive scenarios, video noise also consumes bitstream resources and reduces encoding efficiency during encoding.

Both this method and setVideoDenoiserOptions [1/2] set video noise reduction, but this method allows you to specify the media source to which the noise reduction is applied.

Attention:
  • Call this method after calling enableVideo.
  • Video noise reduction has certain requirements for equipment performance. If your device overheats after you enable video noise reduction, Agora recommends modifying the video noise reduction options to a less performance-consuming level or disabling video noise reduction entirely.
  • Both this method and setExtensionProperty can turn on video noise reduction function:
    • When you use the SDK to capture video, Agora recommends this method (this method only works for video captured by the SDK).
    • When you use an external video source to implement custom video capture, or send an external video source to the SDK, Agora recommends using setExtensionProperty.
  • This method relies on the image enhancement dynamic library libagora_clear_vision_extension.so. If the dynamic library is deleted, the function cannot be enabled normally.

Parameters

enabled
Whether to enable video noise reduction:
  • true: Enable video noise reduction.
  • false: (Default) Disable video noise reduction.
options
The video noise reduction options. See VideoDenoiserOptions.
sourceType
The media source type to which the effect is applied. See MediaSourceType.

Returns

  • 0: Success.
  • < 0: Failure.

setVideoEncoderConfiguration

Sets the video encoder configuration.

public abstract int setVideoEncoderConfiguration(VideoEncoderConfiguration config);

Sets the encoder configuration for the local video. Each configuration profile corresponds to a set of video parameters, including the resolution, frame rate, and bitrate.

Call timing

You can call this method either before or after joining a channel. If the user does not need to reset the video encoding properties after joining the channel, Agora recommends calling this method before enableVideo to reduce the time to render the first video frame.

Restrictions

  • Both this method and the getMirrorApplied method support setting the mirroring effect. Agora recommends that you only choose one method to set it up. Using both methods at the same time causes the mirroring effect to overlap, and the mirroring settings fail.
  • The config specified in this method is the maximum value under ideal network conditions. If the video engine cannot render the video using the specified config due to unreliable network conditions, the parameters further down the list are considered until a successful configuration is found.

Parameters

config
Video profile. See VideoEncoderConfiguration.

Returns

  • 0: Success.
  • < 0: Failure.

setVideoProfile

Sets the video encoder configuration.

public abstract int setVideoProfile(int profile, boolean swapWidthAndHeight);

Details

Deprecated:
This method is deprecated. Use setVideoEncoderConfiguration instead.

This method sets the video encoder configuration. You can call this method either before or after joining a channel. If the user does not need to reset the video encoding properties after joining the channel, Agora recommends calling this method before enableVideo to reduce the time to render the first video frame.

Parameters

profile

Video profile.

swapWidthAndHeight

The SDK outputs video with a fixed width and height according to the video profile (profile) you selected. This parameter sets whether to swap width and height of the video:

  • true: Swap the width and height.
  • false: (Default) Do not swap the width and height.

Returns

  • 0: Success.
  • < 0: Failure.

setVoiceBeautifierParameters

Sets parameters for the preset voice beautifier effects.

public abstract int setVoiceBeautifierParameters(int preset, int param1, int param2);

Details

Call this method to set a gender characteristic and a reverberation effect for the singing beautifier effect. This method sets parameters for the local user who sends an audio stream. After setting the audio parameters, all users in the channel can hear the effect.

To achieve better vocal effects, it is recommended that you call the following APIs before calling this method:
  • Call setAudioScenario to set the audio scenario to high-quality audio scenario, namely AUDIO_SCENARIO_GAME_STREAMING(3).
  • Call setAudioProfile [2/2] to set the profile parameter to MUSIC_HIGH_QUALITY(4) or MUSIC_HIGH_QUALITY_STEREO(5).
Attention:

Parameters

preset
The option for the preset audio effect:
  • SINGING_BEAUTIFIER: The singing beautifier effect.
param1
The gender characteristics options for the singing voice:
  • 1: A male-sounding voice.
  • 2: A female-sounding voice.
param2
The reverberation effect options for the singing voice:
  • 1: The reverberation effect sounds like singing in a small room.
  • 2: The reverberation effect sounds like singing in a large room.
  • 3: The reverberation effect sounds like singing in a hall.